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ABSTBACT 



^ \ This aonographr organized in tuo aajor parts, covers 

the role of. educational needs assessaent *in adult *educ2iticn and its 
role in continuing aedical education (CHE). She first part discusses 
the* concept of \ educational need and its relationship to classic 
prograa planning aodels.and naturalistic prograa planning. It then 
covers various assessaent approaches and data gatheriTig- aethods vith 

, criteria for aodel selection.' A discussion* of t^e rcle cf needs 
assessaent in guiding the prograa planning process concludes this 
first part. The second part presents definitions and the purpose of 
CME followed- by definitions cf coapetencie. It then discusses prograa 
planning aod^ls and approaches to needs assessaent in CHE'. (EM) 
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INTRODUCTION • ' " . 

This statement is organized in two major segments. The , 
fi?*st segment details the role of educational needs assessment in adult 
education. The second section outlines the role of edycationrJ needs 
assessment' in continuing medical education (CME). ' . ' ' 

" The concept' of educational, need and. its relationship to classical 
program planning models-and'nafturalistic program planning are discussed 
in detail. Approaches tcr needs 'assessment^and data-gathering methods 
with criteria for model selection are presented. ' \ 

nk.^^' The role of needs asi>essment in guiding the program pi ariniiig 
processes of adult ^education- and continuing medical education (CHE), are^ 
discussed in depth?. - ' . ' 

• D 

The need for CME, ^a definition of contintiina medical education, 
definit,ions of competence, the purpose pf CHE, program planning models 
and approaches to needs" aissessm.ent in continuing medical education round 
out the second segment of the paper. ^ , ^ 

Comparisons and contrasts of the adult education 'program planning 
process with the continuing medical education program planning process , are 
made where appropriate. These comparisons and contrasts highlight some 
of the basic differences arfd similarities of both pj^ocesses, 
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THE ROLE- OF 'EDUCATIONAL NEEDl>- ASSESSMENT IN ADULT EDUCATION -PROGRAM PLANNING 
TRe^ Concept of Educati on al N eed «^ 

- ^ , . .... 

/ Webster's New World Dictionary defines fou»/ meanings of the 

term "need". These are^(l) necessity of obligation-created^ by. 5oni& . sit- 
uat'ion (2) a lack of something useful, require or desired (3) something 
useful, required, or desired -that. is lacking, want, -requirement, (4) a con- 
dition in which there is a deficiency of something, or one requiring" relief 
or supply. ' * 

According to Boyle andUahn , the adult educator has essentially 
two interpretations; of the cpycept'of^-need, .The. first interpretation is . ' 
based upon the assumption of an inherent ^ growth or jieed-fUvf.il ling' 
tendency in. man. For example, tMaslow sets fortfi a hierarchy of human 
neeids in -which emergence of one need is usually dep'endent upon satisfaction, 
of a more basic need. From most basic to most complex, those needs are: . 



(l) phyj5iologicaV, (2) safety, (3) love, (4) esteem, ana^(5] self- 
actualization. . ' . 

* 4 ' * - . 

Kidd'^s classification of^basic adult needs is confluent witi] 

the first.assumption. The' class jfication^'^is:^* (1) health, (2)' family and 
. • * « - 

friendship relations, (3) socio-civic relations, (4) consumer aspects of 

Jife, (5) occupation, (6) recreation and (7) religious^nd' philosphical 
**'*''-* . * * 

needs. * ' . • * * • 

5 ' t ' - ^ " ' 

Knowles' view of 'human needs iriclude:-^^^' 



Physical needs " ^ 
Growth Needs 

3) /The^Need" for Security 

4) The Need for New ExpeY^ience 

5) • The Need for Affection 

6) The Need for Recognition 



/ 



The second interpratation of need is based upon the assumption that 
equn-jbriuni is a natural state toward which man strives. Need is a 
condition that exists betv/een what is and what should.be, or between what 
7s and that which Is more desireable. Need Is a key instigator of • * 
behavior in that it creates a state of disequilibrium, in thfs interpre- ' 

/tatior;-a-need-always;iniplies-a~gap^j . . . 

. ' HcClusky^s categories of need are confluent witi; the second assuiliption. 
^ccording to IfcClusky', nee'd implies thfe Existence of a desireable cond-v 
ni9n requiring the operation of certain factors for fts -attainment. ■ 
/4cClusky identifies four categories of educational need:' 1) coping • 
needs, 2)* expressive needs*, 3j contributive ndeds,. and ^) influence needs. 

Goping heeds refer to^that group of requirements which must be met 
in order to continue adequate social adjustment, psychological healtf^, ' 
and physical well-being. . 

Expressive needs refer to those areas where individuals enj^ge in 
activity for" its' own salce, activity which is undertaken for its ov/n 
reward and enjoyment. ^ ♦ 

Contributive'needs are those^ich assOme that admits (especially 
older .adul ts) have ^ need to repay 'the- communi ty, a need to be useful-, 

and a destre to be wanted- ' .- * » _ 

•' ■ ' 
■ Influence' needs' are those needs of adults to affect thfe quality and 

direction of their own lives. ' 

, ^Havighurst and-Orr^ identify -developmental tasks-- in adulthood. ^ 
When there is urgency^ to meet any of these developmental tasks, anxiety 
is intensified. This anxiety produces needs or teachable moments. The 
anxiety identified by Havighurst andtOrr is related to tht developmental' 
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patterns oT adults. It is a gap between role'demands or expectations, 
and the_ coping mechanisms possessed by the adul t or- potential learner. 

the most cbmnon. definition of need,* as discussed in the literature ' , 
pertaining to'^eeds'assessment, is a gap. This notion'^of gaps reflects 
the second -assumption and interpretation discussed by Boyle and Jahns.. 

• ^ g • ' 

Malcolm Knowles defines educational need as something a. per-son 
. ought to learn for his or her own ^ood, for the good of an organization, 
or for the .good of society. It is the gap between his or her/oresent >evel 
or competencies and a'higher level required for effective perforiiiance as 
-.defined by that individual, the organization, or the society." (See Figure 1) 

Required Level of Competency 



Educational Need 



present Level % of Competency 



; FIGURE. 1: Kfiowles' Illustration of Educational Need , » 
Alan B .Knox^° 'refers ta. educational need as a gap between a present, 
^or initial, or existing set of circumstances and some changed set of circum- 
stances may be described in tefrns of how the individual and/or someone 
else would have the individual 'slnov/l edge, performance ,afd attitudes 
di-f-fer fndm^.the.Jnltial.^et^of^circumstances^{-5ee-Figur6-2-) - - - 
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Changed/Desired 
Circumstances 



— DATA • 
POTENTJ^ GAP 



DATA 



Figure 2: Illustration of Educational Need (Knox,. Woods, fteans)^' 



Need and Classical Program Planning ^ - 

Defined educational need >s a coacept integral to learner oriented instr- 
uction. ITearner oriented instruction is a construct of modehi adult 
education philosphy'''. Powell andBenne'^ distinguish two major schools ^ 
of adult education philosphy.' One is the 'rati ojialist school which has 
never had a name for its own philosophy and practice. It opertftes^under' 
many banners:^ liberal arts, reading-discussion, great boolcs, humanities. 
The other, the developmental 1st school, represents the opposite end of * 
the continuum. It has twb conspicuous camps; (1) fundamental education, 
whose principal apex is community xievelopment;. and (2) human relations, 
-whose most inten^'ve focus is group dynamics. For all three schools, (i.e 
rationalist, coinnunity development^ and group dynamit:s,) the most effective 
matrix for individual learning is membership in a continuing face-to-face 

gcoup^^ (' • . 

' ' ' \ ^ — 

On one side lies individual self-directfed learning, by 

reading or other evocativ^ refleciiortu.upon experience^ On 

the other stand lectures and the mass^nSaia:, Which are- admitted 

to have value>irt coftmun^Gatifig fenowjodg^. and understanding/ 

The favoi^te vehicle^^ Mult -I'^^trrnng Activity is the group 

* ♦hweVe*;,^ the..5i^up and consnunity- emphasis, 

there ts^a stroiTg^d vital agreem£nt;on the individual 

as the learner, the agent of learning of of ju(^$nent and 

acting, the goal and test o? all the'lVarning-^ituations * " 

that educators can devi&e* ' r \ 



The'gQal of adult/continuing education administxators and program 

* ' ' 's f r 
planners is to. design and offer *prt)gramSwWh'ich. fulfill the educational 

requirements of the target adult population^^. Successful' attainment of 

•this goal depends ilq, part upon reliable' information concerning the unmet 

continuing. edijcai ton neVds and interests, of .adults. Adults demand % 
z' . ■ ^\ . ' 

relevant infQrmation — and prograjus t^aj provide.Jes^ cannot be completely 

1 fi ' ' * ' 17 

effective . Needs assessment is a siiie qua nom of prograsTplanning • 
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Program planning models of Bergevin, Morris, and Smith- Easley, 
Houle, Knowles, Kndx, and London- corroborate the significance of educ- 
ational needs' assessment. Because adults do not iiave to go to school, 
but undertake adult education courses voluntarily, programs roust be based^ 
on needs and interests which thesajsludents themselves express or which . 

they can be led to recognjze- The needs of adults which the educators 

4 ^ ^' . ^ 

seek, to meet are not jiist "felt needs" but also the needs whic^ educatbfcf 

impute when they view the gap between what is and .what could be if their 

stadsnts achieved their fulV potential 

Bergevin, ftorris, and Smith present, their !'Six-Step Procedure" ^ 

of adult education program development in ^Aclult Education Procedo^es^ ^: 

Step 1 Identifying a Commgn Need or Irtterest 
, , Slep 2 Developing Topics ' .\ " 

Step 3 Setting &)als . ^ * 

Step 4 Selecting Appropriate Resources . ' 

Step 5 Selecting Apprppriate Techniques and' 
"Sub technique^ 

— — Step 6 Outlining Each Activity and the Responsibilities 
to be Carried Out . , 
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The authors, suggest that identification of a coimion need (Step 1) 
must be achieved, if only generally, and that steps 2 and 3 serve to refi 

the need defined in the first step. * 

"19 , ^ 
Easley lists five steps to successful program development: 

1. ' Identify the Problem-- Determine the educational 

needs of adults in the community (target population) 

2. / Make a Judgemen t about^ the Possi b1 e P rogram Inputs - Give 
""^™^^~^^~^onsTaeration to those 'inputs needed to resolve the 

immediate problem. 

3. Determine objectives - Gain specificity. Care should 
be taken that they are stated in terms that all parties 
can understand. 

4. Itesign the Program.- Consider format, leadership, instruct 
^ ional methods, materials, group cbfresiveness, and 

evaluation stratecfies. 
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V - 5. -^F^vitle, Adn]XDi5trati^^^ Supports - Support in guidance, 
:v >fiMDC^^^ instruction, evaluation, 

- T .and:^ene^al program- review.. - \ i ^ 

* fasteyiconcl^ planning- and development is b&th / 

art art and^^a ;s44en^^ it invol^s looking at the^rogram from the ' 

iiijtial needs assessment to the review of the total program as' an 

entity^°: ^ ; / ' . ** ' 



9< 

In The Design of Education , Cyril 0. Houle ' suggests a cyclical 
iriodel of program development in'which the activities of the seventh step 
provide input to /the firsJv"(5ce Figure 3) ^ ' - 



It A possible educational activity is idestined 

I 

2. A dccijIonSs made to proceed ' ' 

|. - " . , ■ 

3. Objectives arc Identified andTcfiaed 

a. Kesourccf 

b. Leaders 
c Methods 
d. Schedule, 

4. A suitable fcimat Is designed / Sequence 

^ 1. Social jreinforccnient 
.g. Indmduallzatlon 

Roles and relationshipi 
h Criteria of evaluation 
j. Clarity ofdejiga- 

/a. Guidance 



»^ »w \- • - . jb. Lifestyle 

5,. llic foTTOte fit^d into larger pattenu of life W Rnani 

(d«Intczpretation- 



6. The plan Is put info eH^ect* 
7^ The resiilts'aiemeajured and appraised 



4 

Figure 3: Houle's Model of Program Development 
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.'•Seventh step activities -include maasurement and appraisal of -program 

outcomes against set program objectives (step 3) ^and exaniinati6n of -the 

, situation .in terms of the possibility of a new educational activity 

' • • . . - . ■ ■ 

(step 1.).- Hel-e the cycle of program planning reconmences. 

The thi^^!^step of Knowles"^- "andragogical process of program 

development is "diagnosis of needs for learning". - .Snowies suggests that 

needs for learning may be dia^ilosed through development of competency 

* models, assessing- level -of performance, and assessment of learning ne^ds. 

The author lists the following phases for concise program .development: 

- - ,1. The. establishment of a climate conducive to adult 

. . . * Teaf-ning.^ - " - , 

2. The creation of an organizational 'structujre for part- 
icipative planning, 
<^ 3. The dia'gn(feis of needs for learning. ' , ^ 

* 4. The formulation of directions of learaing y 

(objectives;):. < 

5. The development of a design of activities, ^ * 

6. The operation of the activities. 
' 7- The rediagnosis of needs for learning (evaluation). 

There would be no poitit'in ^vaVuatihg (phase 7) if it 'did-^not result 

in action of some sort. .Objectives (phase 4) can be altered in the liglit. 

vof the newmeeds and interests of participants that have been revealed 

in the evaluation process^. * * ' 

The prografm d'evelopment model of Alan B. Knox^^ includes: 

' ..^ r ' _ ^1 ientefe Anal ysi s /Needs Assessment., „ 

^1^'^ 7. Avia feness of HSetti ng' - ^ 

^^'^^'^V • ^' Determinant! on of Objectives 

r . y • • 4.^^. Selection 3nd Organization of Learning Activities . * 

V ^ ' ^ 5.' Evaluatjon - • ^ ' 

' . • V. -?* . / * " 

"».««• • 

f .Evaluation information obtained through comparing expectatjoj)s with - v 

9,^--/, . / ' / ^ . • " — - — ^;^/^ ' 

performance, monitoring planning activities, monitoring educational activities^, 
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and diagnosing educational activities (stage 5) is , returned to stage 
One (clientele analysis/needs assessment) of the Knox model. The • 

process is a^ cyclical one. ' . . - ' 

25 ■ * ' • * * * ' • • 

Jack LonQon lists five steps to successful adult education *' 

.program development:' ^ • • • 

' 1. Determine the need's of the. cons titutuen'ts 

2. Enlist their participation in planniqig 

3. Formulate clear 'objectives 

^ 4. Design a p.rograra plan , " , • . ^ 

"5. Plan and carry out' a system of evaluatioi>^' 

London desc/fbes an interdependent relationship o-f'steps 1, 3, and 

4/ If an acti'VHy has clear and imnediate -s^elevan^re-to the participant's 

own particular needs and interests, it will attract 'and hold them, and 

thus bririg.about the desired^changes exjfressed Jtt the objectives'^. 



OBjectives should T)e based on determined: educatldhal deeds', 

it'eed and Natural-is t-i c-P-1 anni ng— - — _ — . 

Adult and continuing -ediTcation program development is much ^1 ike* 
curriculum development within primary, secondary, or higher education. "* 
Both program and, curriculum' development are processes by whirh'a given 
subject matter is transmitted to fi specific audience. They ire, in 
essence, methods of planning from the inftial ^^onception of an Idea 
through, the^ class project, final* examination, or en'd-of-course critique' 

^^^^^ -^^--TSjfieYeariin on >^ 

. curriculum development, many writers in continuing" 
education deal only with what they consider to be ' 
either essential aspects of the development process 
or tfblistic models. Tv/o^such mojde^s originating 
.from curriculum design .research, ami being adapted 

S *for etther prescriptive or descriptive purposes in 

continuing education, are the.classifcal model developed 
by Ralph T/ler (1963> and a more -natural is tic model 
f espoused by Decker -Walker^S. , ^ 



■■/■•■•. ■ ■ 

The program ,efevel6pment models of Bergevin, Morris, and Smith, Easley, 
• • ^ . ' 
Houle, Knowles,»Knox^ and London depict program development in classical 

(Tylerian) terms. Knox describes the classical process as one involving 

five major aspects: (a) needs.. assessment, (b) determination of object 

ives, -(c) selection and organization of learning activities, (d) evalu- 

ation, and, (e) institutional arrangements for support* 

The naturalistic model can be described as a- series if decision points 

relating fo both the explicit design, (i^e.r decisions made only after 

forethought and. consideration of alternatives) and^'the .implicit design, 

(i.e., action based on precedent' and habit without .the cqnsideratioTi of 

al/ternatives). Differences in 'the two models are succinctly described 

by Walker^°: . • r ' ' . 

This model (naturalistic) is pr.imarily descrfptive, 
whereas, the classical model is prescriptive. . T^is mo'del 
is basically a temporal one: . H postulates a beginning* 
. ('the platform), and end (the design), ^nd a process 
(<Jeliberation)^y means" of which ±he beginning progresses 
to the end. Irr contrast,, the classical model is . a-means- 
end model; it postulates | desired erjd (the objective), 
a means -for attaining this endJ-thleTeiarnirig. experience),.* 
and a process (evaltrationj--fofdeterniininc| whether the' . 
means -does indeed brinj about the end. The t/io /nodels- 
differ radi-^ally-in the roles they assign to- objectives- 
and to eyaluafion in the process of curriculum (prqgr.am)'. ' ' 
, ' developments- , * 

,* * * . > 

^^bjectives are essential in the cUssical model; since, wi'thout 
an objective. Turning experiences cannot be ratibtvally selected and 
Assessed. Objectives are not required in the naturalistic model, since '. 
they are -only .one many me'ans for guiding the search for tetter -educ- 
ational programs.* 

Evaluation in the classical mod.el is a self-correctjVe process 
meant to erase speculation in determining whether learnijig experiences 



lead p the attainment gi-ven objectives. This kind of evaluation is 
not Ipgically necessary in. the 'naturalistic model. Although empirical \ 
' da'ta can b.e compelling evidence in a justificatory argument, design : 

decisions nani be jiistified b> reference to the platform only. 

• • ! ■ ' •* 

Walker describes the platfo'rm ? ,tern of beliefs and values 

that the-progrctfR developer brings to bis task and that guides the devel - 

^' *■ ■ ft 

opment of the program. The- platftfmi includes an idea of what is and a 
vision of what ought'to be,'' and these guid§ the program developer in 
determining wb'at' he should do to realize "his vision^^. 
.• ' Deldber^ation, -seeond element of. the naturalistic mboel is 

characterized, by Schw^b"^^ as follbws:' 

* " • ,f - 

Deliberation -is complex -and arduous. It treats. 

• ■ both ends and means, and myst trieatsithem'as mutually 

determining one another. .-It must try- to-i.dentify, 
- • y/h'th. respect to both, what facts may be relevant.. It ' ' 
.must trj''to asceas^ain thp relevant facts in the concrete 
case. It'must genercrte^,ajternative solutions. It 
must make every effort to trcrce-,the brancjiing pathways of 
consequences which. may- flow from eath--aVternative and 
affect desiderata.- It must then weigh alternatives and 
their costs and consequences against one ano'tli^, and 
choose, not the right alternative, for there is no 
such, thing, but the'best fyne. 

: ' Design is the third element of the .naturalistic model. If is 

the set of abstract^, relationship.5 embodied in the designed object. The 

design is the theoretically significant output ^f the program development 

process — the set of relationships embodied "in the material s-in-use 

which are capable of affecting students"^''. Design may be specified by 

the series of decisions that. produce it. The main components of the 

naturalistic model are illustrated ir> Figure 4: 



/ 
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Figure 4: A Schematic Diagram of the Main - 
Components of the Naturalistic Model 

The concept of educational need is integrated in the platform, 
deliberation and design elements of the naturalistic model. Platform 
includes a vision of what is and what ought to be... Delibemion must 
ascertain relevant facts and identify desiderata. Design is the 
significant output of the program deve.lopment process. In both modsls 
(classical and n^ituralistic), learner need may be identified as the 
rai son d'etre of program planning activities. 
Approache/ to Needs Assessment 

An e!ducational needs assessment is defined as a systematiq, process 
for identifying and documenting conditions of human or organizational need 



which e'dulational services can help resoTve^^. "There is no one univer- 
sally acceded model of the process,. In iher thesis on educational 
needs as3es*sment, Barbule'sco^^ finds: „ , 

A review of literature about "needs assessment" indica|teS 
that other terms, such as. "need identification" (Campbell 
•and Markle: 1968), "need analysis" (Knox: 1969), ^ 
"discrepancy analysis" (Kaufman: 1972), and."need diagnosis" 
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•(Atwood:- 1973; Atwood and Ellis: 197S{ Hendenhall: 1973),' 
are used to refer to tbe needs assessment pnlc^s. 

Few needs assessment models orNostruments jiave been extensively field 

tested for vatfdity and reliability^^. / ' " • ' ' ' 

Mckinley^^ identifies three families- of educational needs assess-/ 

,< ' t. \ . . • 

men t models: (1) 'Individual self- fulfillment models, (2) Indivtdual 
appraisal models, wid (3) System discrepancy models. Each family is 
formed of two types of rpodels (See figure 5). ' ' - 



1 Fimdles of C($u^tt1on«1 
f{eed& Assessment Ho^U: 


Indfyfdufti Stlf*Fulf111i»itt 




SysteA discreptncy 


Types of NodeU 
^ Ulthfn the fMfty: 


1. lUndoa Appeal' - 
1. Sflectfvt AppMl 


1. Col1»bor*t1vt Indfyfdutl 
Appraisal 

I. Stif-Apprfisti 





rigurt S; KeKlnltjr'* CJMtlfl?»tlofl of EAicjtljMl Kttdi AsstsjaMi HxiiU 
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"Random Appea'l" an'd "Selective Appeal" modfels' form the first family , 
(i.e., Indi-vidual Self-fulfillment). With Random Appeal "models, all adults 
.in the community are viewed as potentja^l participants. iriL the prqgram'that 
IS to'result from ihe diagnosis (needs assessment). Needs are usually ' 
defined as individual interests that are potent enough to i n vol ^.d"* part- 
icipants in the program. The result of a diagnosis is usually a broad 
cafeteria-type program that attracts a large number of persons. Data- 
gathering methods include telephone surveys, quesrtionnaire surveys, 
advisory con¥nittee recommendations^ suggestion- boxes, interviev/o., ajid 
various combienations of such procedures. Need is identified when a syf- • 
ficient number of persons indicate that they will' participate in an- 
activity thus making it economically feasible'^^: 

, Selective Appeal models, focus on" the needs of 'a known segment 
of the population (e.g., women, retirees, or those who have not completed 
high school').- Clients may be known as individuals .and solicited as ' 
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learners on the basis of their interest in or presumed need for the 
subject matter of a particular program. . "Continuing Education for Women" 
and "Pre-retirement Education" are examples of programming which' result* 
from this type of need- assessment. Such 'programs are generally not 
based on'local diagnosis, but rather on research data, packaged materials, 
and program formats already tested with the specialtzed population. 

Individual Appraisal models, McKinley's second family^ of diagnostic 
models,-* are those in which the clients are usually consciously involved 
IT) ^determining th^ir learning needs. The proces$es are either collabor- 
ative or'non-collaboratiye. "Collaborative Indivij^al Appraisal "Models 
include both one-to-one" approaches (as between client arid counselor) and 
group approaches in which j'ndividual- needs are assessed as a function 
of the group"^^. "Self-appraisal" models are non-collaborative. The 
learner,may choose to utilize scales and other ins trumented exercises, 
or a.group settjng .(as in value clarification) , but self-diagnosis, is 
conceived as an individual task and*a function of individual experience' 
in such a group setting. Self-diagnosis is not. necessarily an explicit 
group goal or a cooperative function in which the findings are revealed 



to the group. The* concepts of co-llaborative and non-col Taborative 

ssme 
41 ■ 



•approaches to needs assessment are 'supported by Atwood ,*and 



Stubblefield and -Robens 

System Discrepancy models are termed discrepancy models because 
they either assume the existance of," or attempt to identify, the gap or 
discrepancy between "what is" an<^"what ought to be" in a social system^^. « 
The social system is usually an organization*, a sub-unit of an or^|g^zatioh 
or a conmunity. These models generally approach educational needs a's 
deficiencies of jcnowledge and. skills. The knowledge and skills are seen 



as neces-jap^ eilher to solve system problems o^- to attain some desired» 
specifvid endstate.. 

The "Problem-Need" -approach is^one type of System Discrepency model. 
"Goa;-Identif3cafion" is the -other. The Problem-Need model facilitates 
developlnent of programs thart-are remedial in -nature* Programs aYe 
remedial, since educational needs and derived ^cational objectives are 
related directly to diagnosed difficulties in the ta»*get system. .The 
Goal -Identification modal' facilitates educational programming with~a 
general improvernent thrust rather* than" a specific remedial focus. It 
assumes thaf educational objectives which are carefully derived .fr-om 
the official goals of the client system*, will reflect desired learning 
outcomes that some isducators would term .rieeds^^^ 

Kaufman discusses inductive (Type J,)^ -deductive (Type D), and ' 
classical (Type C) approaches to needs assessment. Sources of data, the 
degree of involvement of clients in the needs assessment process, and 
the extent o'f -systemi^ation of needs assessment 'procedures used are 
criteria utilized by Kaufman to differentiate the three models. •,(See~' 
Figure 6j . ' - ' 
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Identify Ext«nt Behavtors (*) 

Compile and Classify 

Behaviors Into Programs 

and Behavior Expectancies (^*} 

Corpp^rc to Existing Broad ; 
Coals ^ 

Reconcile 'Discrepancies (*) 

$et Oetatted Objectives (**) ^ 
f 

develop Educational 
. Program (^^) 

Implement Educational 
Program (**) 

# Evaluate Educational 
Outcomes ^{*) 

Revise " . . * 



* Type P . . 

Identify and Select 

Extant Goals of " ♦ - • 

Education i * - 

OevelQp Criterion 
* Measures 

Obtain Change 
Requirements C*)"^ 

Collect Performance 
Data and Determine 
• Discrepancies 

Set- Detailed Objectives (**) 

Develop Educational 
Program ^ 

. f 

, Implement Educational 
Program (^*) 

Evaluate Educational 
Outcomes ^(*) t . ' ] 

Revise 



'1 

* Type C 
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Gc;>erlc Co»l$ (**) 

DeveTop Programs 

implement Educctlopal 
Program • 

Evaluate {***) 



if) *ccbRip]fshed by educatprs'and representatives of 

sub-cofnmunlty tncmbers served by the agency' 
(**) AcepmpUshed primarily by educators * 
(***)frlmarlly accomplished unsystematlcaily 

'Figure 6: , Kaufman's Generic Strategies for Assessing Educational 
Needs and Idejitifi cation Goals 
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^ Although ^tated criteria and characteristics of Kaufman's intiuctive ' 
and deductive. models differ,- these models coincide with McKinley's 
ProWem-Need and Goal-Identificat|on models, 'respectively.' The Type 1 
and Problem-Need models begin W-ith a search foV' extant behaviors from 
which educational goals (objectives) may be derived. The TypQ D and Goal- 
Identification model's, begin with the identification of extant goals 
which may facilitate educational programming that reflects, desired learning 
outcomes. • . . " 

15 • ' ■ 
Hand discusses three approaches to needs assessment: 1) the 

social welfare approach, 2) the ecological approach, and 3) .a comnunity . 

.development approach. The first ifwo approaches are differentiated by 
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whatjs being examined:' ^ocial agencies, institutions, and services; 
or temporal and spacial relations of people in a community unit. The 
two approaches are mutually exclusive. The third approach (conmunity 
development) is utilitarian in nature^' Needs assessment is viewed in 
terms of ifs. outcomes, (i.e. / Identified needs), and as an educational 
process that .can bringV^rticipants together who may then engage in 
social change. ^ . j * . 

Just as there is no universally acce|Dted educational needs assess- 
ment model, so there' is no one, generally used set of criteria for 
judging models. In the absence of such criteria, T^itkin^^ suggests the 
following list of questions as guidelines to model setection: 

1 . General model characteristics^ 

- Does it have all the components .of a comp3ete model? i 

- Has it been- field tested and evaluated? ^ 
-*Is it easily replicable? 

- Does 'it provide for broad and widespread panticipation 

of the educational * and lay community? ^ 

- Is the cost reasonable, and commensurate with ^the benefits 
to be gained? " ^ . 

- Does it' have- a clear management structure? 

2. Technical characteristics 

- Are all the $teps clearly explained and illustrated?- 

- Are the limi*tations of the method stated? " , - 

- Are the forms or instruments clear? 

- If no forms are provided, are there instructions for 
. local development? 

... -'Are the data to be collected unambiguous? Is- a distinction * 
made between process/learner and outcome/ institutional needs, 
and betv/een "needs", '"solutions", and "resources"? . 

- Does it appear to have plidity - i.e., will the p.rocess 
actually generate the data anticipated. nr^needed? • - ^ 

-.Are .methods, given for-synthesi zing 'Objective and 'subjective 
data? . ^ 

3. Contextual criteria _ 

. - Is the model adjustable to local conditions? - 
' - Is it designed to develop a reasonable list of recommendations 
for action? 
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-*Will the procedures be acceptable to different ethnic, cult- 
' ural, ahd socioeconomic groups? Are non-English versions of 
the materials available for non-English-speaking participants? 

- Does it have a built-in mechanism for cpntinuity and easy 
transition to ^a' succeeding model for the next stage? '■ 

- Does it provide* some mechanism for renewal* of the system, 
anticipaiting and responding to social changes? 

- Is there a mechanism for evaluation of the progress and of 
the outcomes of the needs assessment itself? 

Development of models is still in the beginningjtagesil.. Models which 
may rate high on some criteria may rate lower on-olhers. Criteria which 

have the most meaning tojhe^el^ctor 'should be applied to models which 

have the most suitable general set of characteristics. 

Needs Assessment Data-ga'thering Methods . ' • ■ 

'48 ' ' 

Verner encourages the adult educator to know th^ zsey'sex^ occup- 

4 ' ' ' 

ation, previous education, area of residence, stage in the life cycle, pol- 
itical orientation* level of aspiration, level of-,achievemeht, attitudes 
and a vast array of other social, physiological and psychological char- 
acteVistics of^his or her participants in order to design learning exper- 
iences to meet their' needs. Knowles^^ identifies six general methods for 
obtainingisuch information. 

Interviews provide the best method for enabling the researcher to 
understand how and why participants feel as they do. Understanding 
participants' feelings is vital to any educdtional effort. 

Written Questionnaires enable the researcher to reach a large number 
of people in a relatively short period of time. Ideally, respondent's 
feelings can be recorded and and processed quickly, anonymously, and 
, .without the, embarassment or anxiety which may accompany more 
personal techniques. 

i 

Management records and- reports may provide clues to educational needs. 
. Absenteeism, tardiness, turnover, audit reports, and production 
records are reasonably objective evidence which can supplement other 
need information. , • ^ 

Tests can aid in determining' .whether a deficiency exists in knowledge, 
• or skills, or attitudes of the adult learner. Performance or achieve- 
ment tests are essentially means of sampling what learners know or 
can do,, and can therefore help to locate areas in which* more inform- 
ation or more skill training is needed. ^ 
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Group problem analysis Is particularly effeg^ive in the organ- 
isational setting. Groups of supervisors in a given division 
bureau, for .example, might analj^ze the causes of these problems 
. to analyze the causes of these 4)roblems, and t^decide what changes 
are necessary to solve the problem. 

^ Job aoalysis combined with perfonnance appraisal is an effective 
technique. It is time consuming and' consists largely of observation 
and personal inquiry of supervisors, and employees. Analysis 
is. complex and expensive. ^ ^ ' 

Figure 7 l>sts general metbodfe of needs determinaWn,, as well as 
advantages, limitations, and aborted rules of application for each method: 
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Figure 7- Knowles^^^General Methods of Need Determination. 
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-Kempfer^^ liste thirteen possible, methods of identifying educational 
needs and interests. They are: » ^ 

1 ) * i n di V i dijal regues ts far^ouraes, 

2) check lisits and other "interest finders", . - 

3) check with other Icnov/n interests of people (e.g-, library ' 
reading interests, newspaper -and magazine- readership 
surveys), ' ' 

4) sensitivity to civic, personal, and social problems of people - 
, problems which can be alleviated by education, 

5) act on a "hunch" 

-^examine catalogues, schedules, publicity materials, and programs* 
of comparable institutions, 
1) examine published surveys'of other communities- and similar 
literature, ^ ^ _ ' 

8) , systematic survey of the industrial, business,, fivic, and 

cultural life of the community, ^^.^ • 

9) examine data from the cenSus and similar sourcesi-'V' 

10) study deficiencies of adults (e.g., poor nUtritfoh,'low educ- 
ational level, lack of xivic4)articipati6n"^ip&or methods of 

, child rearing), ' " \ - 

11) requests from business, industry, labor, and*cdmmunitr/ groupsr^ 

12) systematically cultivate a group ^of "coordinators'.' in industry, 
business, and other c ormnunity organizations and" agencies who 

^watch for every opportunity for education to perform a service, 
and ^ . 

13) jnaintain an extensive personal acquaintance viith a wide range 
of conwunity leaders and groups. 
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Keir^fer^' describes ^ach method.^ He states that the easiest way for 

planners to fi d -out what adults want to learji is to be alert to their 

individual requests for courses , "Careful directors," ^e says, -"keep 

cumulative lists of all inquiries 'and encourage the inquirers to interest 

enough others to warrant starting the courses". 

Programs built on requests from biisihess, industrial, labor,* ^nd 

community groups are ordinarily much larger than those catering merely tb , 

the expressed or implicit needs of individuals^ The best programs are 

those in which planners tultivatera group of coor dinators In industry, 

business^ and other coirounity organizations . As the coordinators' compet- 

encies in identifying educational needs intereases, much of the work of 

defining needs -is done befoi^e the problem reaches the director* Gpntact 



with coimiunity groups and leaders also enables the program planner to 

be sensitive to civic, personal, and social proTj^lems of the people . There 

Is no substitute for wide personal acquaintan^cervn^ community leaders.. 

Systematic surveys of the industrial^ business, civic, and cultural 
life of the community often lead to .significant insights. .If the adult 
education planner, can share iii planning community surveys of cultural 
resources, occupational trends, recreational activitfes, and coimnunity 
leadership structures, he/she may -maximize their use in identifying educat- 
ional needs. >Examinations of published surveys of other corranunities and 
similar literature are almost as" revealing of educational need as are 
original surveys. 

Where little time and money are at stake,, hunches may pay dividends. 
Only a few planners a?e able to identify the components of a hunch. ^Some 
directors depend upon check lists of interests which are distributed .la 
jclasses^drjt^mee^^^^ are 
often unreliable because needs may change between tabulation of results and ' 
implementation, and check lists often start with program possibilities 
rather than needs of Sdiilts. Planners may test public interest in an 
activity by publicizing it. If there is enough response, 'the activity 

materializes; otherwise it fails. • • 

& * * 

' Data from the census and similar sources, statistically portray social 

V 

and economic conditions in vai:ious major and minor political subdivisions. 
Magazines, newspapers, and libraries are likeljr to ha ve"^ reliable information 
oh the reading habits and interests of adults ; the chamber of conferee on 
economic conditions; social agencies, on the welfare load and the specifics 
of family and community disorganization;/ the* housing/ office and real- 



^estate people on the migration patterri 
"Indeed," states Kempfer, "it is difficult to find a private agency which 
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cannot throw some light on the educational needs and interests of acjults." 

Published sunveys, of other communities and similar literature may *' 
be a.useful needs assessment |echnique, but the value of this technique 
is somewhat limited by the difficulty of finding totally comparable pop- •* 
ulations.. This same limitation applies to examination of catalogues, ' 
schedules , publicity materials, and programs of comparable: insitutitions ^ 
„ ■ Deficiencies of adults often indicate educational needs and provide 
one point of departure in program building. Adults may be largely unaware 
of inadequacies y/hich are revealed by surveys and statistics. ,Yet, mal- 
nutrition, ill-healthi and family .disorganization may indicate important 
educational tasks. • * 
" ' Kempfer points out that in any needs analysis it-ts 'irnportant (1) tQ 
break down the adult population in several ways so that the -most' useful 
cfroliping can be identified, (2) to analyze the educational nelds and 
4n±eces^s,.o£^ch- 5PO.UB^-=amM=3^)^to^avel op. educational-^Gti-vi-ti es-4n-4erms 
of those rieeds and interests. 

• ... 

in her r»eview of literature relevant to needs assessment, Barbulesco^^ 
t- • *- " ■■: ' ' " ■'- ' 

identifies ten needs assessment' techniques. She describes: 1) (junches, 

2) publicity, 3) requests, 4) reports, publications, and records,.5) external 

consultahts, 6) observation, 7) tests and examinations, 8) personal contacts 

wi^^h coimiunity leaders, and agency and organization personnel, 9) survey, and 

10) groups, advisory committees, and task forces. , . . 

Barbulesco's description of hunches is essentially identical .to that 

of Kempfer. Publicity is described as a "one-way street" in that it does 

not invite or stimulate requests for new programs, but it is u^eful in 

providing* statements of polijcy. . * ' 



.Reliance solely upon requests limits the focus of educational programs 
to the expressed needs of the'-'mbst vocal individuals or-groups, or of* 
those who have the power *to exert political pressure on'an educational ' 
agency. Swift action on^uplicated requests nearly ens.ures participatiofi. 

ReEorts, publications' , and records include policy Uatements, such; 
as. statements of training requ^"rements Jn. organizations; and catalogues,^* 
schedules, publicity materials, and programs .of fered in com'parable inst- ' 
itutions. ^Census reports, reports of private and governmental agencies, 
. and records pf various types 'can be tapped as indicators of poss'ible need. 
-The overlap of this! technique with four methods, (i.e., numbers 3, 6, 7,' 
and 9) discussed^Jj^mpfer is apparent. . . 

Process or subject-matter expjerts from outside the' educational fsetting 
in which a needs-assessmenf study is being conducted may serve- as external 
consultants. External consultants can pro\ride new iiiformati^)n and insights 
'about theory^>^facts,'principles, and concepts tha$ relate to determining 
educational nee^. *A possible disadvantage in using external consultants 
is that such individuals may not have a full grasp' of the. complexities* 
and interrelationships of persons w.ith'in'a particular setting. * ' 

' Although- observation may oT-ovide clues to problems, it -is time-- 
consuming^ requires special training for' observers, and risks producing 
anxiety on the part of those being observed. 

Tests and examinations are used: 1) as a technique to evaluate 
1earner,.progress, and 2) as a diagnostic tooT for identifying specific 
areas of learner deficiencies. Barbulesco, Knowles, and Copeland^^ submit 
that tests and examinations cari measure levels of knowledge as well as 
quality of performance. (See Figure 7, Knowles, "General Methods of Need 
Determination.) ' . . ^ 

-* * . " ' * 

' *» 
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Systematically developing and maintaining personal contacts with 
commuoity leaders, and agency and orgemrzation personnel is one of ,the 
nxDst. effective ways to assess educational needs?^. Key individuals in 
groups and orgalrizations may serve as liasons between the group and 
organization and the educational institution. * ■ ' * 

Survey . is the most widely used technique for needs assessment. The 
relative advantages and disadvantages of personal interviews and written 
questionnaires are listed under Knowles' general methods. 

Copeland^^ discusses another approach to identifying needs. The 
Critical Incident Technique, according- to Coqeland, is useful in that 
it Is empirically based, iden.tifies both effective and ineffective behavior 
^and provides a basis for identifying problems. Respondents are asked to 
think of a recent experience of a highly specific type and asked both to 
describe who was involved, as well as what led to *,the incident. The 
approach is -time-consuming. A large number of cases may be required and 
special training is needed by the individuals who must gather the ,nformati( 

. Kaufman ° descnbes *the Delphi Technique as a method used to forecast 
the development and timing of future events. -It is a lype of survey which 
relies primarily on the combined expertise of several selected authorities.. 
Chosen experts if) a variety of fields related to the assessment of particul 
educational needs receiye a series of questionnaires. Each questionnaire 
is based on the results of the previous one. Each respondent is allowed ' 
to change his or^her views as opinions and information of others are- 
proyided to him or her. ^ In other words, there is a collection of responses 
to questionnaire items eliciting information about the long-range future 
of educational needs^ This information is then summarized and returned to , 
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the group until, a final normative indication of need is presented. Eff6,ct- 
iveness o-f the Delphi Technique is partially determined by the decision 
regarding who comprises the pool of experts. Group .interaction, discussion, 
and debate are eliminated, since experts responses are closely controlled 
sole reliance upon this technique limits the needs assessment process 
strictly to expert participation. Survey technique in general is limited 
by a temporal" factor. That is, opinions expressed on a .questionnaire 
are only opinions expressed at one point ia time^^. They are not necessarily 
commi tpients on the part of respondents. ' ^ 

To encourage groups of citizens to/share- perceptions of educational 
nef2d creates more public awareness of both the complexity of such needs, 
as well as the necessity for a systematic and cooperative approach to - 
meeting them. Groups, advisory committees, and task forces used in needs 
assessment and community analvs,is facilitate a more direct exchange of 
information between the educational institution and the target learner 
group or community. Representatives of the community or potential learner 
population may meet to voice their opinions about educational needs with 
a minimum of structure to limit such expressions. 

More formalized groups, (i.e., advisory groups ^d/or committees), 
may vary greatly in size and responsibility. Kempfer^^refers to: 
1) sfjecial-'area committers whix:h address limited areas (e.g., course problem 
or ta-sk), and are considered most- helpful irt.need identification, and 2) 

♦ 

general committees whicfi usually provide a rough estimation^ of needs in 
broad areas., such as development of family-ljfe, publ ic-affa,irs education 
and inter-cultural understanding* - 

■ • 27 • 
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. . The ta'sk force draws its members primarily from organizations and 
• institutions. It is another group utilization .technique. ; Task force, 
members are us.ual1y experts^ special-is-^?, or leaders in some capacity. 
These ^individuals generally have specif iV: assignments-, roles or res- 
^onsibilities-wthjn the needs assessment process. It is a quick, economical 
^ ^ methoU of aiding in .determination! of a population's felt needs by • 
. interviewing-a cross-section of leaders using a task force of faculty 
-and staff* members as interviewers^^. 

Copeland^^ discusses' general techniques of need determination.' 
, ^ Techniques identified in Copeland's discussion consolidate those lists 
of Knowles, Kempfer, and Barbul^sco. (See Figure 8). 
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Figure 8: Cope] and 's. -General techniques of Need 
, . . '. Determination (See Appendix A) 

A - ' ' 

•Copeland feats' self-evalijation as a separate method. He cautions that 
-this met{).od may be unpleasant for some, and that it is difftcult to be 
objective fn self-evaluation-. The accuracy of self-assessment is limited 
by the individual '•s familiarity with standards, but the assessment is • 
tndivitiu^lized, ■ ^ • , / 
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^ . Methods of needs assessment range from highly systematic and - 

comprehensive, (e.g., critical incident technique, job analysis/performance 

.' ' ' - 

•review, and research findings)" to the very simple and unsystematic, 

(e.g., observation, and'hunches). Propriety of individual methods 

varies with each setting. The researcher who limits himself to a single , 

* » 

method severely limits his ultimate ability to understand the potential 

fil' ' ' 

learner group. Kaufman ^states: 

Tools and techniques for needs .assessment must be 
selected, evolved, or invented.'based on the unique 
conditions and circumstances' of each educational context. 

The field of needs assessment is indeed a fledgling one. 
Many models and procedures are beinjg tried, modified, and 
reapplied. Professionals specializing in this difficult 
ar^a emphasize the tentative nature of any models or 
■ procedures extant. - 

'■ 

Needs assessment may be conducted 'collaboratively, (e.g., groups, 
advisory committees, and task forces), by the researcher/program planner 
alone, (e.g., observation)- oc by the learner alone (e.g., self-evaluation). 
Selection of methods must-be-baseLd Upon both purpose of the proposed 
needs assessment and available resources jn terms^ Tfime,: money /and ' 
personnel. , 

The Rolg of Needs Assessment 

The most critical question related to the needs assessment process is 
"Why -conduct 'a needs assessment?", Grabowski^^ responds that. there is a 
need/ for an operational philosophy— a ctynamic practical instrument 
that is used periodically or continuously for making decisions on 
matters related to eduction. ' • ' ! ^ 



Needs -^assessments gather qualitiative and/or quantitative tnform- 
ation so that decision-makers in education can better determine the 
nature, extent and priority of educational needs. Educators use this 
information. to change and impro\4e education— to make education general Ty 

more effective. Barbulfesco^^ finds:. h . . 

. ' ' ' ' ' 

The ultimate purpose' of a needs assessment is to 
provide an empi/.n'cal -basis for 'decisioh-mak-ing about . 
* .matters related to education, for example, 'the alloc- 
ation of resources or the content area, Style of teaching 
or learning and general organization of educational 
programs. ^-,If educators bypass the needs assessment 
process, according to English and Kaufman (1975), then 
there. is no' comparable jnethod for determining the adequacy 
of educational programs on the basis of vali<lated criteria. 
In as, much as the needs assessment cycle is a continuous . 
^ process, ■'an educational progrlam as a means tp an end 
is also a continuous process and- must be shaped- and re- 
shaped to maintain its relevancy, reliability, validity, 
arid over-arching purposes. ' 

" - ■■ • ' 

The role of educational needs assessment in the adult education 

progr^flsplanriing process may be described, in terms of wh^t it does. 

What does educational needs assesstfient- do? At least two perspectives 

exist. One perspective is that of the 'researcher?program planner or 

sponsor of thg*educational activity. '^The other j*s that of the learner. 

From the first perspecti^, needs assessment: 

». . <■ 

1) accommodates delivery- of learner-oriented" instruction( content 
and format)' through identific^ion af. learning- needs, 

2) facilitates development of program objectives wh'ich can" 
be used to measure the effects of a given educational 
activity, 

3) provides information which can lead to adjustment of 
program objectives, • 

^ 4) provides a way of remaining abreast of educational needs 
^ ^ through somd form of regularized measurement or appraisal, 

5) facilitates prioritization of needs to-ba met with regard, 
to resources of the provider of educational programs, 

6) contributes to the development of ah empirical data base 
. for future decisions related to educational programs or 

. policy. 



7) provides information about learning and teaching styles 
related to educational programs, 

8) contributes to increased learner group involvement in 
educational planning, and • , 

9) tests policies, statements, and potential learning activities 
within. the community. " •» " 

' From .the perspective oiF the adult learner, educational needs 
assessment: 

1-) 'provides the opportunity for formal and informal jjart- 

icipation In, identification of 'a needed learning activity, 
(p.g.'» interviews, questionnaires, and advisory groups), 

2) 'facilitates the provision of relevant learning activities, ' 
. 3) provides opportunity for community involvement in the solution 
of pertinent problems, 

4) provides an- opportunity for conscious and meaningful self- 
evaluation, 

. • 5) • jjrovides information on sponsoring institutions' policies, ' 
. statements, and potential learning activities, and 
6) facilitates pnoritizsltion of learning needs. • * 

The needs assessment process guides the program planning process 

by attempting to identify specific needs (desiderata) within a more gene 

notion of what is and what ought to be. In Walker's naturalistic model 

- of pragram development, the platform includes a vision' of what is and 

a. vision of what ought to "be, within the system of values and beliefs 

that the program planner brings to his task. Through deliberation, (i-.e., 

information gathering, analysis, and utilization), the more specific 

desiderata must be Identified, and an effective program design should 

result. The classical model of program planning 'also begins with a 

vision of what is and what ought to' be. However, the classical program 

planner attempts to 'separate his/her values from that' vision. Ideally, 

formal needs assessment explicates the planner from^his/her value system. 

The dynamic is the same in both types of program planning: 
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Classical Planning ' 

The planner begins with a notion 
of needs (scientifically or otherwise 
defined)-, and embarks upon the program/- 
planning process with that notion/ 

'* Data is gathered in an effort to 
make -effective 'design decisions and 
determine learner objectives, 

so that learners may experience a 

more meaningful and, effective educational 

activity. 



Naturalistic' 
Planning 

.Platform 



Deliberation 



Program Design 



* While distinctions between activities in the classical model may 
•be more defined. than in the naturalistic model, the flow of activities' 
for each model is simi'larly guided by the concepts of need, and needs 
assessment. 



Dbfinitfoh of Continuing Medical Education * 

The concept of an educational continuum in medicine is not. a new 

'65 

one . A report by the Commission on Medical Education of the American 

* 

Medical Association^^ published in 1532 states: 

1. That the education sequence from premedical education to 
retirement from practice be looked upon broadly as a single 

^ problem, not a succession of isolated and unrelated 
- experiences. . . ' 

2. That the conti;iued education of physicians is synonymous with 
^ood m'edi^l practice, and prov]sions\should be mad? ultimately 
whereby every physician will be able to" continue. his education. 
The time m?iy come when every physician may be required in the 
public' interest to take continuation courses to insure that 
his practice will be kept abreast of current methods of diag- 
nosis, treatment, and prevention-. 

3. That the problems of postgraduate medical education are 
closely interwoven with those of practice and education. 

The great need at the moment is to; secure^ joint leadership ^ 
in a program which Will embody 4he educational ideals and 
. methods of the university and the highest type of medical 
practice. ' ' / 
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Richards ■ identifies four distingt phases of the jnedical education 

~ - . • • * - 

continuum. (See Table ,1) < . ^ 

» 



Coctiauui 



tlctfuTu^ft.er 
Ctrtiflaicion 



Frtmcdlc4il Uucfttloo 




CraduAte Kedlccl 


ZUa<nt«r7 cad 
Secondary School » 
Colltst 


TWdlcol EducitlOQ 


education 


Mlcal School 


XnCenuhlp t«ild€&cy 



K*dic«r 



I. 



* 'c&ntlnuinl Tfctt-* ' 
' tr<doftt«). XedlcU ' 
gduc* t loa cod ^ ^ *^ ' 



' 1 yr. -^-^ to 7 yrs. 



25'»to 40 yr*. 



tic tat t to 



Specialty 
C«rrlf'lc«tloa 



Crcntlof A^*ncy 
t 



tfodlccl StJitt 
School K»dlc«I 
_ tloard* 



f^Sp#cUlty 
to«rdt 



Table 1: Richards' Continuum of ftedical Education 

V 

Little more than TO years ago continuing education was a term on^ly 

68 

just coming into Use in ipany countries • Now it is common parlance^®. In 
some parts of the world, postgraduate education is a synonym for continuing 
education. In other regions, the term (postgraduate education) may refer 
to any education after completion of a basic program; including specialty 

m 

training^ Recognizing these differences, a World Health Organization Expert 

Committee defined continuing medical education (Cf€) as follows: 

' .r • . the training that an individual physjcian ' 
undertakes after the end of his ^asjc medical - \ 

education, andwhere applicable, after the end of 
• any additional education for a career as a 
• ' - generalist or a specialist— training tn improve 

his competence as a* practitioner (not with a -g 
view to gaining a new qualifying- diploma or licence) v 

The definition ;of the WHO Cojranittee is represented diagramaticallj 
in Figure 9: ^ , 
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ADVANCED MEDICAL 
EDUCATION 
(SPECIALIZATION) 




Possible 

^ P- degree ;or 

diploma 



Possible* 
degree or 
diploma 



figure 9: WHO Committee's Stages of Medical Education 

The American Medical Association (AMA)^^ defines CME as follow^: 

Continuing medical education consists of those 
educational activities engaged in^by individuals 
possessing a degree of doctor of medicine which ara 
primarily designed to keep them abreaat of their f 
own particular field in medicine: Such activitifis 
are intended both to refresh the individual in 
various aspects of his basic medical education 
and inform him of the new developments within • 
his field, and do not lea^ to any formal advanced 
standing in the profession. 

Both the' WHO and* the AMA definition of CHE coincide with the fourth * 

phase of Richards' continuum, (i.e., continuing medical education follows 

specialty certification)." The Am indicates that CME does not lead to 

formal advanced standing in the profession. The WHO indicates that CME 

does not .lead. to a new qualifying diploma or license. 



Purpose of Continuing Medical Education ' 

"• In his landmark report of 1910, Abraham Flexner''^ states: 

The postgraduate school as developed in the UiVited 
States may be characterized as a '"compensatory 
adjustment". ^ It Is an effort to mend a machine that 
. was predestined to break down. Inevitably, the more 
• conscientious and intelligent men trained in most 
of the medical schools herein described must become 
aware of their unfitness for the responsibilities of 
medical practice; the postgraduate school was est- 
ablished to do what the medical school had failed to 
accomplish. ' , , * 
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The AMA statement of. object! ves for CME adds ah introduct6ry , 
"component to the remedial focus docurhentejd by Flexher* The AMA states 



that objectives for CME programs should include*: 1) changes in: the 

attitude and .approach of the -learner to the solution of medical problems; 

2) correctidji of outdated knowledge; 3) tha explication of new knowledge 

in specific areas"; 4) the introduction to and/or mastery of specific 

# - - • • 

skills and JfechniqueSi and alteration in the habits of the learner- 
The ultim'ate aim of continuing medical education is improved healthjcare^ 
of the patient. Continuing exudation should make it possible for each 
physician to use^ in his practice tjie modern fnedical knowledge that! . * 
continuously becomes ayailable. ' , \ 

The World Health Organization ^ reflects the AMA concern fofthe 
delivery of new knowledge. Tliefy state that the sole objective of Cf€ 
is to assist physicians to maintain ancl extend their professional competence, 
whatever the area of medical practice. The, ultimate purpose of continuing 
education is to improve the quality of preventive and curative care given 

9 • 

^physicians-. ' , - ' 

Rubenstein Kampmeier^^, Jessee and Goran^^, and Silverman and 
Hurst^^, represent the conventional belief of most' physicians and 
.physician educators.^ Their works support the contention that^the ultimate 
aim of continuing. m.edical -education is to improve heal th care of the 
patient. Whether or not CME can affect competence and result in , 
Improved health care delivery is s\:ill an issue^^. 

Competence , - - ^ ' 

The dictionary^ defines competence as the condition or qualityvpf 
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being competent. Competent means T) well quaTif^ed; capable; fit. 
[a competent doctor] 2)- sufficient; adequate [a. competent understanding 
of law] 3) permissible\r properly belonging (with to) 4) legally 
qualified, autiigrized or fit. 

The' dictionary definition accounts for at least three disparate inter- 
pretations of the term competent. Clearly, the differences betv/een perceptions 
of well qualified (definition *#1), sufficient (definition #2) , and perftiissible 
(definition #3) might well serve as points' on an ordinal scale. . ' 

Dobbert^?, and Cyrs and Dobbert^i., identify components of competence. 
Competency js. defined as an intellectual, attitudinal, and/or motor cap- ■ 
ability derived from a spea'fied role and setting, and stated in'terms of 
performance as a broad class^'or domain-'»of behavioc.- 

Knox^^; Pennington, Means, and Elliott^^ and feaker-and Gordon^.^ 
identify three comparable com{)onents: I) attitude, 2) knowledge, and 
3) skills. The differences Between the components are better delineated 
when viewed in a program planning context. For instance,' a very different 
set of learning experiences would be appropriate if the purpose of a program 
was. to develop interest in geriatrics, or to acquire knowledge about 
geriatrics or to develop skill in diagnosing health problems particular to 

older people. • / . 

85 J- 
•Miller identifies^components of clinical competence pertaining to 

•* . ■ . * 

orthopedics, through an. analysis of over 1,700 critical incidents contrib- 

uted by practicing orthopedists. Those competencies are relevant to most 

areas 'of medicine. They, are listed here: ' 
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1. /Skill in gathering clinical information: 

a^ Eliciting historical information . , 

b. Obtaining information by physical 'examination ' - 

2. Effectiveness in using special diagnostic mathodsr 

a. Obtaining and interpreting x-ray films ' ^ 

b- * Obtaining additional information by o^her means 

3. Competence in developing a diagnosis^'/, ' >o . 

a; Approaching diagnosis objectively^ 'I . ^ ' , 

b/ Recognizing conditions'. ^ ' : 

* . " • *. . ' 

4. ^Judgement in deciding on appropriate care:' 

a. Adapting, treatment to. individual cases 
.b. Determiaing extent and iimediacy of therapeutic heeds ' ' 

^ 5. Judgement and skill in implementing treatment: 

a. Planning the operation 

b. . Making necessary preparations for the operation ' ' 
% c. Modifyi/^g operative -plans according to situation 

6. Effectiveness in treating emergency patients: 

a. Handling patients 

b. Performing emergency treatment ' 

( 

7. CoQipetence in providing continuing care: 

a. Attention postoperatively 

b. ^Monitoring patien's progress 

8. Effectiveness of physician-patient relationships: 
at. Showing concern and consideration 

. b. Relieving anxiety of patient and family . , - 

9. Accepting responsibility for the welfare of the patient: 

a. Recognizing professional capabilities and limitations 

b. Relating effectively to other medical persons , 

In listing a^ definition of competence, the AMA^^ cautions that the 
true quality of medical care, tfie maintenance or restoration of the 
patients' health and well being as^ a result of appropriate human efforts by 
the health care team given at a reasonable cost, can never, be completely 
evaluated any more than it can be completely defined; no/etheless, a reason- 
able , "workabl e estimate ^ competence can be made. ThdAMA definition 
of competence is as follows: 
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A .n)Q55yj;e.d leyel of patient care oOtcomes (end 
resu1t5lacb.te.yed>y an tndtytdual health pr^ctionar, 
or grcap of health practitioners Cteara), that -is accept- 
able whftn .cwared to a standard developed *t)y a current 
consws«5, -inttt-ally, or self^.and p^er^-.fnd,' ultimately, 
tiy* releivant outside sources . Ccriter ion 'groups ) ,. 

Essenttally, the AMA deftnitfon indtcates^t'lrat' competence cannot be 
ineasijred coaqt-saly-, but that it can be approximated through comparative ^ 
examination. That is, patient care outcomes can be compared to standards 
developed by one's self, peers, or other criterion groups. Gaps^.in 
knowledge, skills, and attitudes should register accordingly. 

The'propriety of standards for deterniining competence is open to question 
Development of standards by one's self necessitates some skill and is limited, 
since standards are derived from a system-limited purview. That is, in- 
novated standards may hot develop since in-put from outside the medical 
care system is TimisEed. Development of standards by other criterion groups 
suffers from the same shortcomings as self and peer standard development. 
. Pennington and Moore"' list four role pers;)ectives which must be 

1 

considered for developraeat of standards and other issues. The public de- 
mands that quality medical care be available and delivered lo all its 
members. The medical profession must be conce^rned about disagreement 
within the profession regarding theories and approaches to medical practice. 
The educator must consider whether or not continuing medical education can 
guarantee competent health care delivery* The individual physician mu5^t 

face the problem of knov/l edge obsolescence.' 

go . ^ * * 

Houle states that generations of scholars have "fought against great 

obstacles to embody the highest principles of profess ionalisrn, but now 

professions are in peril both by invasion from without and by decay from 

.within, He suggestsonly two.po§sible alternatives: 1} set up newer, lower, 



and more realistic standards, or 2) raise the level practice. 
The Need for Organized Continuing Medical Education , ' ' - 





Derbyshire and Frandson^^. It is a widely held belief. Toffler^^ finds; 

Prior to 1500, by the most optimistic estimates, Europe 
was producing books at a rate of 1,000 titles per year. This means, 
_ • give or take a bit, that it would take a full century to produce^ 
library of .100,000 titles. By 1950, four^and d fialf centuries later, 
the rate had accelerated so sharply that Europe was producing 120,000 
title's a year.. What once took a century now took only ten months. 
By 1960, a single decade later, the rate had made another significant- 
jump, so that a century's work could be completed in seven and a 
half months. And, by the mid-sixties, the output of books on a 
world scale, Europe included,>xapproached the prodigious 
figure of 1000 titles per day.^ 

One can hardly argue that every book is* a net gain for th*e. 
advancement of knowledge. Nevertheless, we findttet the accelerative 
curve in book publication does* in fact, crudely parallel the rate- 
at which man discovered new knowledge. . ' 

*, • ' 

Credulity of the Toff ler statement has been bandied. about and tested 
by many interested scholars. Here it serves only to illustrate (specifically' 
in parallel with medical knowledge) an assumption internalized by many 
medical educators. 

Curricular half life is a concept which accompanies the notix)n of 
knowledge explosion. Figure 10 illustrates the concept of curricular half- 
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Figure 10: Decreasing Number of Years to a Given Percentaqe 
of Potential Obsolescence 

The vertical axis represents years to obsolescence-^the years it wAld take 
for a given percentage of the graduate^s educatijDn to become obsolete if . 
the graduate did not learn anything after graduation. The horizontal axis 
h the year of graduation. Two lines are plotteclwith thejowej^ line giving, 
the half life of the tiirriculum. That 1s the rtumber of years required for 
a program to change 50% after a given date. The -upper Line displays the 
time to m% obsolescence.; that is the expected years after griduation in ' 
which the entire cbntent of the four year undergraduate programiwill change^?. 

'VanClevelOO. Biedenback^O^ . IllichlO^ gl j04, ^urrle 

and Rogers^°^ and Stewart^O^ 'oite increasing demand for quality health 
care as another reas'on Cf€ is needed, Pfiysicians must maintain competence ^ 
to cope jvlth the growing number; of patients artd their expectations. Blum states: 

' National expectation ^ political prom'isers, and health care 
purveyors have all and always promised that no one will go wlthout 
health care. Our cards are being called by a society that believes 
It can „af ford anything wltbjn 'j^-eason. ' ac ucnevt;:. _ 

108 . ■ ' ' 

IlUch explains the socfal phenomenon described by Blum as- "the 

crists of medicine". Illich states that the Westernized publicjhas 

leaimed to daman d effective medical' pi^actice as defined by the progress of 

medical science, and, that paopTe have lost the right to declare themselves 

sick. People now accept their claims to sickness only after ceiitifi cation 



by medical bureaucrats. iStewart^^^ 



notes- that care should be taken In 
'^1 ' ' 



( 
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distinguishing between demand and need for health care. .That is, the 
demand for health care is generally considered higher than^the ne^d for 
health care. 

Pickett^^°, Lewis^^^ Smith^^^, and Mann et al^^^, indicate that piost 
doctors feel it is^of great importance to have the opportunity to utilize 
their present skills -ind to acquire new knowledge and skills. The determin- 
ation of the physician to continue his education is the sharpest indicator 
of the need for CME-. H, suggests that as the oc6upant of. a highly 

privileged and protected role," the professional (physician) feejs a sense 
of obligation to his clients (patients) and to society to keejJ his service 

at the highest possible level. » . 

115 ' • » ■' 

Miller contends that we are convinced that it is our failure 

to, apply new knowledge which represents the weakest .link fn the chain of ' ^ 

assuring the highest quality of medical care. When, in fact, correction 

of major health problems does not appear to require any substantial body^ 

of new knowledge. - Rather, it requires that phys^^ician's use the knowledge* 

they already have in a different way or more fully exhibit the professional 

attitudes that traditionally have characterized the physician-! s role. 

Miller also contends that need-based instruction is a relatively new 
concept to medical educators, and that , physicians are not eager to expbse 
their hospital work to others. F.urther, he suggests, that a physician '■s office 
practice is virtually impregnable. 

Finally, Miller asserts that there is no connection between continuing 
medical educat.ion and improved patient care. It is only assumption that 
'deficiencies in health care exist \xit tliatthey could be corrected through 
appropriate conti nuing^ education. ' 
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* 116 • • ■« • 

Lewis supports* filer's contentions in tv/o respects. He suggests 

thatin a sweeping generalization the demand is made that, because the know- 
ledgethat one acquires at a given point is lost in a period of 5 to 12 
yaarsj^'the physician should continually restore'his knowledge. Lew,is 
- contends that knowledge necessary for the everyday practice of.medicine is 
•xogstantly recalled, refined, and rfiade more effective by continuous psych- 
ological reinforcement. The knowledge which is lost is thaf which because' 

n ■ . 

it lacks relevance, has not been used. 

Le!^1s also suggests that "the explosion of medical knowledge" is a 
■ * i' 

cliche invoked for the purpose of demanding continuing medical education. 
He finds that revojutionary^w concepts in all scientific endeavors do not 
come with the rapidity of machirie gun fire. "Much of the explosion of 
rrtedical knowledge", he states, "constitutes merely additions to a large 
corpus of information and knowledge added to old paradigms, thus adding 
merely redundancy". 

In spite of the issues raised by Miller and Lewis, the need for 
organized continuing medical education characterizes the conventional 
wisdom of the profession. The Gonmission on Physicians for the Future^-^^ 
finds that with the rapidity of changes in modern medicine, it "is crucial 
that the practicing physician participate ifi continuing education. The' 
American Medical Association^ states:" 

Physician competence is a fundameti-tal element of quality . 
medical care, and, likewise, medical education is basic 
to competence. Medical education's goal is the production 
of physicians equipped to provide optimal care for the 
public. The ultimate evaluation of an educational system is 
the effectiveness of its products. Questions raised about' 
quality of care and professional competence are ones of 
primary interest to medical education. The growing problem 
of malpractice suits gives added impetus to this issue. 
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Continuing medvisl education is universally endorsed as the principaT 
vehicle for maintaining medical competence^ 



^ROGRAM PLANNING. IN CHE ' . • 

... it is asserted that the process by^which particularly 
. effective and innovative programs of continuing professional* 
education a^e developed, is basically the same across all 
professional fields. It is further asserted thafth.is 
process '^by which effective programs of continiTing-profess- 
ional education are developed, it similar to -the' general 
process by wjiich effective programs of adiilt and continuing 
education are developed... (Alan B. Knox'^^)" 



Penningto/Tand Green examined continuing education program planning 
processes across six, professions in eleven -major institutions of higher 
education. Results supported the idea tbat. tile planning process comprised*, 
a series of tasks and decisions that seemed to cTuster around six gnoups 
of activities. The term/Cluster is used to describe. 3; single group of 
activities.' The General Planning Model identified by Pennington and Green 
is portrayed in Figure 11. ' " 




Figure 11, The General Planning Model of Pennington and 
Green 
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Several Rrogram origifis characteri^d the first cluster. . Ideas 

origin^M;ed from: 1) a formal needs assessment, 2) requests from a 

cl'ient. or, client group, the availability of project monies, 

4) legislative mandate, and 5), suggestions from campus faculty and staff* 

. A:;tiv1 ties of the- second cluster, were thpse designed-'to test and refine 

"the idea before a commitment to proceed with a program was made* Activities 

included: ' ' . ^ 

1. - Test the idea informally with othe<^ practicing professionals 
, to explore the extent of interest. 

Z.^ Test the idea with campus peers to help identify resources. 

and begin- tp'make the idea more speciflcrand manageable* . ^ 
Z. Conduct a review of literature as ,a source of current ideas * " 

related to the program request* _ 
^ 4. Assess institutional interest and delivery capabilities* 
5* Enlisit, planners J:o shap[& the possible. response to the request. ' 
'6. Conduct some market a/ialysjs to see if the program would 

pay for itself* . 
7* -Conduct a structured needs assessment focusing on the extent 

of interest in the idea* , 

A cofnmitmeot to go through with tffe program characterized th'e third 
cluster* Activities' included: , . V ' • 

1* An- instructor was selected and in some instances. ^}r6 vided with 

orientation concerning teacliing adults* ^ 
2* ^ A decision was made. concerning the use^of campus faculty 

members or outside experts* * 
3. A decision was made about using an existing campus course, or 

developing a hew learning activity io^ the program* ^ 
4* Some consideration was given to Why the professionals wanted 
, ' to attend the activity and what the pfobable characteristics • 

^ ^ ^ of the target audience woujd be* 

5* The logistics of recruitment, ^publicity and arrangements for 

facilities. w^re started* 

'Instructioriai design was the focus of activities lin the, fourth cluster. 
Activities were: i) determinq;^ object! yes, 2) state objectives, 3).'develop 
subject matter, 4) possibly 'review literature, 5) design or 'accumulate 

♦ 

materials, and 6) select* instructional methods. 
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The learning activity occurred jntc1:as$er five. It usually occurred 
ay pTanried, but some flexibility was maintained that permitted changes'-in ' 
focus and methods in response to learner needs.-. Some evaluation of the 
activity occurred in this cluster. 

Cluster. six was made up of six activities: 1) determine methods 
for judging the success of the program, 2) determine what to ev^luate,' 
37 develop evaluation instruments, 4) determine w^io would use the evaluation, 
5) administer' the evaluation, and 6) utilize the evaluation results. ' 

The Pennington and Green planning model is characterized by the rig- 
orous step-wise progression of classical planning, as well as ,the less 
rigid activity flow of the naturalistic model. The six clustenslof activity 
are sequenced systematically (in the traditional mode). Yet, the planning 

process is engaged through deliberation (in the naturalistic mode). - 

* 122 ' - ' 

..•Hutchinson suggests that needs, readiness to change, and' stable 

patterns of cooperation become more perfectly defined as the program planning 

process continues. Hutchison lists seven major steps in planning. They are: 

1) -Formulate and enunciate the philosophy: "Who are we, what 
do we believe, why do we plan?. What will happen if we do not 
intervene.?" 

2.) eiarify the goals: "What are we working toward?" 

3) State the objectives: "What specifically are we going to do, 
in what sequence, and when?" 

4) "Assess obstacles and restraints: "What will we do about them?" 

5) Determine scope and thrust of program activities. 

6) Control through management: "What personnel needed? Who does ' 
What? What financial base is required? How do we keep th? 
activity on the pre-determined track?" 

7) . Evaluate and revise:. "How will we measure and monitor progress, 

and feed in new information for continued effective prbgranining? 
How will we know that we- have accomplished what we set out to do?" 

Charfer^and Blakely^^^ ill us tVate^ another general model of continuing 

education program planning. (See figure 12) This model is an elaboration 

of what Chartejy^and Blakely call the basic problem-solving process. The 
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basic problem-solving process has six/steps: l^recognize a diiTTiculty, 
2) analyze the difficulty and .generate a testable hypothesis, 3) consider 
all available alternatives of trying to solve the problem and plan and 
organize an attack, 4) implement the courseof treatment, 5) assess the'^ 
outcome of the treatment, and 6) determine steps to be taken next, as ^ 
indicated by the outcom^. 
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Figure 12: Charters' and Blakely^s.Model of Continuing Education 
. , Process " 
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Dobbert presents a general model of competency based curriculum 

* 

development (See Figure 13). The ftjodel i§ comprised tif seven procedures. 
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Figure\13: Dobberfs General Model of Competency Based Curriculum 
Development , 

In describing the model, Dobbert states that the first procedure Cl .0) 
in Figure 13 results in 'identification of the position or performance for 
which instructional development is appropriate, or- should be aborted. 
Competencies and performance levels are identified as procedure (2.0). 
Revalidation of competencies (4.0) when feedback from the maintenance of 
curriculum procedure (7,;o) identifies a need. Assessment procedures (3.0) 
are developed for measurement of the competencies as an attribute of an 
individual. Almost concurrently, curriculum" is developed (5.0) and tested 
using the assessment procedures -(3.0) to' measure attainment of the compete 
encies by those completing the curriculum.- Concurrently, a curriculum 
delivery and operation procedure (6.0) is developed. 'This operational' 
planning is- implemented and modified as experience and performance directs. 
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Feedback from pilot testing and implementation of instruction directs 
attention to competencies with^an inappropriate criteria- level or instruction. - 
When the program is operating a strategy for maintaining it is. implemented 
(7.0). This procedure provides feedback for operation in (6.0),- assessment 
modification in (3.0), and th§ "revalidation of competencies in (4.0). 
Program maintenance is the heart of the model. It insures curricular viability. 

Brown and Uhl^^^, and Miller^^? contend that despite existing 
program planning models, a conceptual scheme has not been developed which 
would relate educatio;ial programs directly to identified physician- and . 
patient-need, and would also rfemonstr^te for the physician and the educator 
that the need has/has not been met. Such a conceptual' scheme would require 
that patient care be judged by objective criteria. 

APPROACHES TO NEE PS. ASSESSMENT IN CHE ' ' ' ' ■ 
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- Accreditation requirements of the AMA^^^ stipulate that educational 

♦ 

objectives, should be based on CME needs. CME needs may' be described in 
terms of physicians' knowledge, skills, and/or attitudes. 

Storey, Williamson, and Castle^ warn that learning needs of physicians 
are complex. They suggest: ■ % . 

Tners has been a tendency to identify newer methods of conmun- 
ication. as the means to close the gap that is thought to exist 
Mtwseo_m-fiverJacjmsJn5_sjtm!^ 



, application- to clinical, practice. This is an over-simplified 
solution to the problems of continuing medical education. 
Such a solution, whil« convenient, overlooks Jthe ultimate 
problem— that the communicators may in fact be quite unaware 
of what it is that must be communicated. 

130 

Green's first cluster of -activities indicates sources for ideas of 
what continuing medical educators attempt to <;omiTiunicate (See Figure 1.4). 
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Figu^e 14: Green's Originating the Idea Cluster 

A nuqiber of .approaches to assessment of physician learner needs have 
been utilized by program, deve\opers.- Donabedianl32 designates three types 
of appraisal. -They are: 1) Valuation of structure. 2) evaluation of process 
3) evaluation of outcomes'. Appraisal of structure involves the evaluation of 
the settings and instrumentalities available and used for th| provision of . 
care-. The term structure, as used here, also signifies the properties of 
the resources used to provide care and the manner In which they are organized. 
Assessment of process is the evaluation of the activities of physicians 
. . in the management of patients. Assessment of outcomes is the eval- ■ 
uation of .the end results in terms of health and satisfaction. " 

Two assumptions underly appraisal of structure. The first is that better 
^ar^is more likely to^be pn)Jd.ded-when-better-qQariTfeia"staff, 



Physical facili'ties and sounder fiscal and admi.nistrative organization are' 
employed. The second assumption, according to Donabedian, is that we know 
what^s good in terms of staff , physical structure, and fonnal organization. 
It is apparent and generally conceded' that appraisal of structure is too 
indirect to be definitive. 
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The process assessment model focuses on the evaluation of what was done. 
It is retrospe.ctive. There are essentially three types of process assessments: 
1) peer review, 2) medical audit,. and 3), utilization review^^^. -.Methods 
include review of tests, procedures and rpcords which a physician has ordered. ' 
Participants and roles are defined fcfy the type of process assessment. 

her review is characterized by three steps: 1) find out what needs to 
be changed, 2) learn how to change^it, and 3) change it^^^. .Peer review is 
generally practiced intfemally by a health care institution as part of its ' 

own responsibility. • . 

■ * 

Medical audit stresses. a comparison of what was done with what was promised. 
Existing standards of patient care may be adopted or new ones, developed 
against which actual per^ormanQe is compared. Standards rtay be adopted or 
developed with peers or supervisors. They may also be non-collaborative efforts. 

Utilization review is. the most coimon process assessment; It is meant 

» 

to evaluate propriety of: 1) hospital admissiofis, 2)' length of stay, 
3) ancillary tests, and 4) charges ioY care rentiered. .Utilization review 
c^n be conducted internally or extennally. 

Outcome assessment is more gen&ral than process assessment.- 'It considers 
the provider?, |he patients a^id Vn^ gen^eral medical care system. Two outcomes 
are stressed: 1) clinical outcomes? (diagnosis and therapy) and 2) economic 
outcomes (cost for both patient and provider). Outcome assessments are 
practiced by Professional Standard Review Organizations and Joijit Comm'isslon . 
on the Accreditation of Hospitals. Marty other local and state review organ- 
izat.ions 'afso rely upon the outcome assesspient method. 

Houle- suggests^ that men "and women know- what they need to learn. -The 
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task of the educator of adults is \o discover what it is and provide it for 
•them, keep.incj^ome continuing medical educators have instituted programs 
of learner self-assessment. ' 

The most popular v/pe of self-assessment is employed by the University 
of Wisconsin. The Individual Physiciari'Vwfile ,is a technique by which a 
physician can study his practice and relate his continuing education to it^^^ 
It is a process whereby an educational prescription is develo'ped" for a 
single practicing physician, based upon three types of data: 



1 

4 



• . '(a) A profile of .the practice is developed by a sampling method, 

whereby the physician reports on every patient 'cpnta-rt one day 
a week for a month. The profile represents a four-day sample, 
- , or about 200 patient contacts for a family physician. • 

(b) A 125,, question, multiple-choice test related 'to the practice 
profile is taken by the-. physician. 

(c) An hour-loir^ interview is conducted between the physidi.an and 
an educational consultant, based on the practice profile, test 

- . results, and other subjective information about him and his 
- practice. Items discussed-are his .persohaV learning styles, 
,-• his perceived strengths and weaknesses^ an'd aspects of office 
management which'may affect quality of car^^^?; . 

1 38 ■» 

Stein suggests self-assessment of needs through^the use of formal 

and 'informal self-assessment programs* He provides physicians with various 

directories^^and references,, wherein physicians adopt an appropriate heuristic 

or inquire- for further information. For instance. Stein suggests to the 

physician-learner: . . , ' 

S.tart by jotting down whatever Teaming needs 

occur to you. DON'T worry about whether your ^ ■ 

list includes little or big items. , 

Another alternative .Stein suggests is a formal, self-assessment program, 

"Clinical Simulations, Selected Problems in Patient Management". 

/log ■ " , ' ■ 

Brown and Uhl present the bi-cycle- concept; fgr assessing needs 
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in the hospital setting. (See- FJgure 'lS) In the bi -cycle -concept the 
patient-care cycle begins wiih.the patient and his interaction with his 
physician who: 1) determines all the patient's problems, and 2) cpmpiles a . 
.problem-oriented record. The problem orie^ited records are weighted by disease 
entity.. The' diseases whicij^use the greatest disability among Jiospi tali zed ■ 

^ — * - 

-patients are rank^ron" the' basis of preventable disability; An audit comnitte? 
in each department sets perforiiiance criterion. Whenthe department adopts the 
ideal criterion of management or performance, it JbecomesT the- standard against 
which actual physician performance is judged; As actua1*performance'..is* com- 
pared to. criterion performance through an evaluation process in the audit com- 
mlttee, significant gags c^n be identified. ^ The gaps represent improvement 

'potential. - - \ ^ 
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Pfiysicfan actions and behavior for closing the gap to improve patient 
care can then be translated directly in^ education program objectives. 
With defined educational^ objectives in terms of behaviors, the bi-cycle 
concept proceeds from the patient-c&re cycle to the educational cycle. 

Mazmanian and Pennington^^^ suggest the use of existing data -sources for 
needs identification. Information is gathered from two sources: 1) indiv- 
idual practitioners, and '2) others related' to health care delivery." Inform- 
ation is classified according to Bradshaw's^^^ conceptual scheme: ij normative 
need, 2) felt need, 3) expressed rteed, and 4) comparative need. Normative 
needs are those which the experts define- Tfiese expei^ts often set acceptable 
or desirable standcirds of practice and then compare them with current practice 
•as they perceive it. A felt need is equated with want- Physicians may be 
asked, "Do you want information on tbe most recent and effective treatment * 
of Derma tophytosisf" An affirmative response is« a felt need. An expressed 
need is a felt need turned into action. Those who plan CI€ for otlfers may 
perceive expressed npeds in the form of requests for topics from program 
participants. Jhe individual physician requesting the program,* sifting thVough 
journals, or seeking consultation regarding a^particular problem is expressing 
educational need. Comparative needs are those identified by studying 
different individuals, groups, or communities who should be expected to have 
similar characteristics. 

All relevant information is analyzed in terms of current physician 
conripetence vs. desireable knowledge, sfcills, or attitudes. As infarmation 
Is acquired, gaps become identifiable. Information sources include but are 
not limited to: 1) mortality rates, 2) tnorbidity rates, 3) CKE enrallment 
statistics, 4) federal ahd 'other research priorities, 5)' presentation - 
outlines, 6) requests from Individual practitioners, 7) requests from groups 
of practitioners, 8) course catalogues of ot^ier sponsors, and 9) professional 
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142 * ' ' 

Wender, et al, suggest that physicians' learni/)g needs may be identified 

through comparison of literature search requests., 'Records of requests, sub- 

mi tted by practicing physicians may be tabulated and compared against requests 

of fourth year students -serving preceptorships. Patterns of requests may 

tndicat' =rning needs of practitioners. . .. 

A number of formal needs,.assessment techniques may facilitate the origination 
of an Idea. Survey research is one of the most commonly employed. Frequently, 

';thod is directed more toward' preliminary exploration- than educational 
needs ass^sment. It is generally constructed to provide a clientele analy^sis.' 

Clientele analyses identify physician characteristics and their attitudes 
toward CME. Variables generally include specialty, type of practice, setting, 
recency of ^ra'duation from medical school, whether or not CME shoyld be required 
times and places most- convenient fqr facilTfatTng atcendance, estimates of . 
jtime ^pent by physicians on CKE activities, and types of CME activities in 
which ♦potential participants are engaged^^^. 

THE ROLE OF NEEDS ASSESSMENT 'IN CME PROGRAM PLANNING 

■Observations of the role of educational needs assessment in CME program 
planning are not to preclude the observations made" in the more general context''"^ 
of adult education program planning. Rather, the CME-specific observations ' 
should be appended and viewed as detail in the process of describing the' 
role of needs assessment in the program planning process. 

» * 

It Is the charge of needs assessment tp: 1} monitor the knowledge, skills, • 
and attitudes of practicing physicians, 2") monitor b. akthrou&hs in medical 
research,' and 3} identify learning gaps between physicians' present competencies 
and destreable competencies. ^ , 
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Two assumptions are inherent to this, task. The first assumption is that 
knowledge, skills and -attitudes ca'n be monitored- with an evaluative sensibility. 
. The second assumption is that medical research i'denttfies inno"ations which ■ 
are applicable.^tb the' practice setting.' J 

For the public, needs assessment attempts tp*bols,ter the quality of 
medical care by identi'fying phys^-cians' learning^eeds which can be met by. 
appropriate educational activities. Needs assessment fulfills accreditation 
requirements which are aimed at satisfying. legislative requirements. Needs 
assessment attempts to' define physician competence in terms of social rteed 
and social demand. ' • ■ 

For the medical profession, educational heeds assessment provides 
valuable information which Contributes to the development of performance and 
other profession^ standards. Needs assessment helps to define competence 
by identifyi.ng'agreenient and disagreement within the profession about theories - 
and approaches to medical practice^ The concept of needs assessment 
functions to buffet and accommodate sociai and legal demands for physicians 
to make concerted efforts at maintaining and extending their competencies. ' 
. While' the concept of need based C^E serves public demand for physician ' 
•education, needs 'assessment affords the profession an. opportunity to ensure 
' that social and legal demands are- met with rational medical input. Output 
, Qf the' needs assessment process should reflect the balsnced infusion of all 
three sources. Needs assessment provides the mec'ical profession with 
educational expertise which hel|)s to ensure effective programminglxf " 
CME activities!- 

' For .the educator, needs assessment provides information on learning 
■\ " / 
■ fprmat..an-d content preferences of physicians. Needs assessment- identifies 
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delivery capabilit'::es of existing continuing education structures. It con- 
siders supply of resource people, cost/benefit ratio, strength of institutional 
conmitment, ^and othjsr. implications of implementation of particular educat- 
lonal activities.^/ Needs assessment provides information on the structure, 
process, and outcomes of ^medical care delivery. 

For the individual physician, needs assessment provides. more meaningful 
learning opportunities through the determination of learning objectives ■ 
based on needs assessment information. It provides the physician with an 
.opportunity. to' determine his learning needs in consort with others (e.g., 
educators, consultants, or peers) or non-col labor? tively. Needs assessment ^ 
directs the physician to a variety of learning -^tivities through which 
^. he may fulfill certification and other- continuing education requi»:ement's.. 
Needs -assessment suggests the responsibility of lifelong learning to the * 
physician." Needs assessments intimates the various responsibilities 
of lifelong learning to the physician. 



/ 



ERIC 



57 



ABBREVIATED NOTES 



.-^Webster's New World Dictionary, 2nd College Edition, 1974:951 

^Boyle and Jahns,. 1970:61 * 

jHaslow in Knowles, 1970:5 

;Kidd, 1959:274 

^Knowles, 1970:81-83 

^Boyle and. Jahns, 1970:61 ' . - 

^HcClusicy, undated: 20 

qHavigffurst and Orr, 1956:34 
, ^Knowles, 1970:85-86 
'"Knox, 1973:K73 , 
,pKnox, Wood^, and Means, 1974:6 
'^Hazmanian, 1976:^3 

{^Powell and Benne, 1960:45 ' " ' • — - ■ - ' 

^^Powell and Benne, 196Q:51 

i^Hertling and Greenberg, March, 1974:7 

iHMcElreath,. March, 1976:232 

I'Easley, 1976:42 

i "London, .1960:66-67 

i^Bergevin, Morris, and Smith, 1963:14-28 
9iEasley, 1976:42-44 
p'Easley, 1976:43 - 
„Houle, 1972i49-56 
"Knowles, 1970:54 
^%owles, 1970:237 
pvKnox, 1967: unpublished copy 
pXLonclon, 1960:66 
^aondon, 1960:69 ' 
P°Green, 1975:6 
onGreen," 1975:6 
olfKnox, October, 1968 
:r' Walker, 1971:58-59 * . - ■ 
■^^Walker„ 1971:52 
^l^y:^^, }970.i36- 
IZm^QV, 1971:53 
^^RQb.biTi5, 1 976 1 VI 2 . 
^?Bari3ulesco, 1976? 27 
^Mt4«tti, 1975'; 9 . 

^^cKinley, 1973?71 • ' 

i^HcKtTiley, 1973.71 
7{«onnete, 1 977 i 120 

J'Atwood, 1973J6-6 ^ 
^■fStubblefield and Roberts, 1973:48 * 



58 



ERIC 

hrjimiimrfTiama 



ERIC 



i^McKinley,. 1973:74 
JZMcKinley, 1973:77 



45 
46 



iKaufman, 1972:33 



copy 



>i7Hand, 1969:148 
jpWitkin, 1975 
JoWrtlcin, 1975:25 
c^Verner, 1964:51 
gl/Knowles, 1^70: 100 
ciKempfer, 1955: 63-^65 
„Kempfer, 1955:66-72 
^jBarbul esco, 1 97,6 :'96-l 1 5 
ggCppel and , 1 972 :.ur.publ 1 shed 
j-^Kn'ox, 1974: unpublished notes 
JrCopeland, 1972:unpublished copy 
c^Kaufman, 1972:'50 
JoBaumel, 1967:28 ' - 
J^Kemp.fer,,. 1955:73 
°yBrooks, 1972-115 
JiCopeland, 1972: unpublished copy 
^;Kaufman, 1972:46 
°^Grabowski ,1975:14 
°jBarbulesco, 1976:35 
J^Coggeshall, 1965:38 
°phepard, 1960:742 

68 
69 
70 
71 
72 
73i 



Richards, 1975:5 

jBriti'sh Journal of Medical Education, 1974:84 
jWorl'd Health Organization, '1973:5 . ' 

American Medical Association, 1977:2 
Flexner, 1910:175 

.American Medical Association, 1977:2 
JWorld Health' Organization, 1973:6 & 13 
^ZRubenstein, 1973:911 
'^Kampmeier, 1977:241 
„Jessee and Goran,' 1976:365 



771 
78 



.Silverman and Hurst, 1974:141 



7 'Pennington and Jtoore, 1977:306-308 
l^Webster's New World Dictionary, 1974:289 
plTDobbert, 1976:2 
,Cyrs and Dohbert, 1976:1 , ' 



82 
83 



Knox, 1967:18 



gfPennii.v^ton, Means and Elliott, 
ggBaker and Gordon, 1975:Part 11 
P^Nakamoto and Verner, undated: 120 



1973;1 



86 
87 



lAmerican Medical Association, 1970:2 
and ftoore, 1977:306 



PpPennington 
SjHoule, 1967:39 
QAAshbaugh and McKean, 1976t1485 
Ji/Garrison, 1974:145 



QlNakampto and Verne 
^^Rockwell, 19^4:705 
Q^Rosenstein, 1969:11-11 
^^CoggeshalL 1965:1 



Verner, 1972: prologue 



..5g 



95 

ggDerbyshire, 1972 

Q^Fi^andson , 1975 --6 

ggToffler,. 1970: 30-31 

QpZelikoff, 1968. in Rosenstein, 1976:25 
inn'^osenstein, 1976:22 
jxl/VanCleve. 1974:335 
jiJlBiedehbach, 1974:794 
^ailich. 1973::i-9 . . 

l^jBlum, 1971:7 
j2>n et ar., 1974:32 

106^"'^'^^*^ ^"^ Rogers, 19761181 
^^yStewart in Medical Tribune . 1968:1 

JnfiBlum. 1971:7 " 

,QgIllich. 1973:6 

iT^Stewart.in Medical Tribune . 1968:3 
, Pickett, 197677 'j 



Lewis, 

;Smijh; 



1973:357 
1974:140 



111 

•112 

J]|Mann et al, '1970:981-990 

|i;Houle, 1970i^3 

j,' ^Miller, 1976:22-25 
j|°Lewis, 1973:357358 

v,j,Coninission.©n~ Physicians for the Future. 
''°AMA In Ufil, 1973^359 
i'^Sanazarro, 1977:1 
jl^Knox, 1967:6 

,v,j,Pe.nnington and Green, 1976:13-23 
jpoHutchison, 1973:104-41 

^Charters arl Blakely, 173:3-4 
jpJCharters and Blakely, 1973:10 
{p^Dobbert, 1976:5.^6 ^ . 

{^XBrown and Uhl, 1970:1662 
i^pHiller, 1976:22 
'^?AHA, 1976:8 

T^^Storey, Will iamson and Castle, 1968:1 
^gvGreen, 1975:100 
,opPennington'and Green, 1976:18 
■jggDonabedtan, 1969:2-3 

mSteiFT, undated copy 



1^76: 14 



TocStein, undated copy 
\i%u1e, 1972:7 ' . 



1 ^fi 

i^TSivertson, Hansen, Shropshire, 
looHeyer, 1974:S170 
I^JSteln, 1973:3, 24-25 
"■,.^gBrown and Uhl-. 1970:1663-1-66 
,%,MazmartTan and Pennington, 1977:in 
jJpBradshaw, 1974:184-187 
'JgWender, et al., 1.977:330-340 
^"'Hafmanian and Pennington, 1977:3 



and Sc'heonenberg'er, 1974:5170 



press 



60 



6IBLI0GRAPHY 



American Medical Association Conference on Medical Manpower, Report from 
Group B-7, 1970. 

American Medical Association, The Physician's Recognition Award - Continuing 
Medical Education Av/ard . Chicago: 1976. 

American MedicaJ Association, Essentials for Accreditation of Institutions 
■ and Orggnizations Offering Continuing Medical. Educati on Programs, 
Chicaigo, July 1, 1977. I " ■ 

•Ashbaugh, David G. and McKean, Robert's., "Continuing Medieal Education: 
The Philosophy and Use of Audit," Journal of the American Medical 
Association , Vol. 235, No. 13, September 27, 1976. ' 

Atwood, Mason H., "Diagnostic Procedure In Adult Education," Viewpoints : 
Bulletin .of the School of Education, Indiana University , Volume 49 
No. 5; September 1973. ~. ^ 

Atwood, Mason H. and Ellis, Joe., "Concept of Need.: An Analysis for Adult 
Education," Vieivpoijits: Bulletin of the>SchooT- of Education, Indiana 
University ; Volume 49 No. 5; September, 1973 (originally published in 
Adult leadership; Volume 19;- January, 1971; pp. 210-212 and 244). 

Baker, Richard H. and Gordon, Michael J., "Competency-Based Objec^tives for 
the Family Physician." Assoalation for Hospital Medical Education 
Journal , April, 1975. ^ 

Barbulesco, Carolyn Watanabe, Educational Needs' Assessment Related To 

Community Problem Solving" Programs In Institutions Of Higher Education : 
Theory and Practice , M.A. Thesis, University of Illinois! Hrhana, 
•Illinois, 1976. : 

Baumel, Phillip C, et al., the Coimiunity Survey, Its Use in Development 
. and Action Programs , Ames: Iowa State University, 1967. 

# - - ' 

Bergevin, Paul, Morris, Dwight and Smith, Robert M., -Adult Education 

Procedures: A Handbook of Tested Patterns for Effective Participation . 
Greenwich, Connecticut: Seabury Press, 1963. . , ' ' 

Biedenbach, Joseph M. , "The Program Brochure as a Teaching-Learning Tool," 
Journal of Medical Education , Vol. 49, August, 1974. 

Blum, Hendrik, "Barriers to Manpower Mobility and Utilization," Health 
Manpower: Adapting In The Seventies . 'Harrv Wit (editor), National 
Health Council: New York, 1971 . 



* 



61 



Boyle, Patrick G. and Jahns, Irwin R. "Program Development and Evaluation," 
Chapter 4 in Handbook of Adult Education , Robert M. Smith, George G. Aker, 
J.R. Kidd (editors), Toronto,.Ontario: Collier-Hacmillan Canada, Ltd., 
1970. 

Bradshaw, Jonathan. "<;oncept of Social Need," Ekistics 220, March, 1974. 

s 

British Journal of Medical Education, "Problems of Continuing Education," 
^Ed4torial^,pp. 84-86, 1974. 

Brown, Clement R., Jr. and Uhl, Henry S. "Mandatory Continuing Education: 
* Sense or Nonsense?" Journal of the American Medrpal Assgciation, 
-Vol. 213 No. 10, September 7, 1970. \ 

^ ^ ^ ' ' 1 • 

Campbell, Vincent and^Markle, David G. Identifying and Formulating Educational 

Problems.. Final Report ; American Institute for Research; Pa^o'Alto, 

California; Far West Laboratories for Educational Resear^ and Development; 

Berkeley, California; April, 1968. 

Charters, Ale,xander N. and Bl^ikely, R.J. Fostering the Growing Need to Learn ,/ 
Department of Health, Education, and Welfare, Division of Regional 
Medical Programs, July, 1973. • 

Coggeshall, Lowell T. Planning-for Medical Progress through Education , 
Association of American Med jcal Colleges: Washington, i).C.: T965* 

Co/mnission on Physicians for the Future, Physicians' for the Future , 
- Josiah Macy, Jr. Foundation: New York, 1976. 

*" 

' Copeland, Harlan G. "Need Appraisal," (unpublished) University of Minnesota, 
1972. ' • - 

Currie,' Bruce F. and Rogers, James A. "The Expanding Classroom: New Jersey^s 
Coordinated CME System," Postgraduate tfedicine . Vol. 59 No. 2, February, 
1976. • ~~7~ ^ - * 

Cyrs, Thomas E. Jr. and Dobbert, Daniel D< "A Compentency Based Curriculum - 
What Is It?" University of Minnesota: - Minneapolis; 1976. 

Derbyshire, Robert C. "Relicgnsur^ for Continued Praetice," paper presented 
at annuuf meeting of Federation of State Medical Boards of the United 
' States, Chicago: February 3, 1972. 

# 

Dobbert, Daniel J. "A General Model .For Competency Based Curriculum Development, 
presented at Adult Education Research Association Convention, San Francisco, 
California: April, 1976. 



Donabedian, Avedlo. A Guide to Medical Care Administration Volume II: Medical 
Care Appraisal - Quality and Utilization . New York; The American Pnhlir 
Health Association, Inc., 1969. 

Easley, Edgar H. "Program. Development" in Materials and Methods in Continuing 
Education . Chester Klevins (editor). New York: Klevins Publications, . 
1976. 

English, Fenwick W. and Kaufman, Roger A. Needs Assessment: A Focus for 
Curriculum Development; Association for Supervision and Curriculum 
Development; Washington, D.C.; ERIC Document #.ED 107.619; 1975. 

Flexner, Abraham. Medical Educa ti on In The United States And Canada . A 
Report to the Carnegie Foundation for the Advancement of Teaching, 
Bulletin No. 4. 1910. . ' 

Frandson, Phillip E. "Continuing Education of the Professions: Issues. Ethics 
and Conflicts." National University Extens-ion Asso ciation Spectator. 
September. 1975. . ~ 

Garrison. Glen E. '"Continuing Medical Education and the Medical College of 
Georgia," Journal of the -Medical Academy of Georgia . Vol. 63. April., 1974. 

Grabowski, Stanley H; "Identification of Assessment of Needs." Proceedings' 
of the Patterns Seminar . David E. Hooker, (editor). Rochester Institute 
of Technology: New York, 1975. 

Green. Joseph Stuart. Continuing Professional Education: A Comparat ive 
' - Analysis Of The Program Development Process i;-, Business Administration. 
Educational Administration And Law (unpublished dissertation) Ph.n. 
University of Illinois. 1975. 

Guralink. David B, (leditor). Webster's N^w World Dictionary of the American ' 
, Language . New York- Will <am Collins and World Publishing Co.. Inc.. ■ 

Hand. Samuel E. "Identifi^cation of Continuing Education" in Administration 
of Continuing Education .. Nathan C. Shaw (editor). National Association 
for Public School Adult Education! Washington. D.C., 1969. 

Havighurst. Rober.t J. and Orr. Betty. Adult Education and Adult Needs 
■ Chicago: Center for the Study of Liberal Education for Adults. 1956. 

f 

Hertling. James and Greenberg, Robert. "Determining Continuing Education 

Needs and Interests: A Study of the Methods Used by National University 
Extension Association Member Institutions." The National Universfty 
Extension Association Spectator . March 1974. 



63- 



ERIC 



Houle, Cyril 0. "The Lengthened Line," Perspectives In Biology and Medici 
Vol. l"}, Nb.^1, University of Chicago: Autumn, 1967. '. 



ne. 



Houle, Cyril 0. "The Comparative Study of 'Continuing Professional Education," 
Convergence , Vol. Ill No. 4, 1970. 

Houle, Cyril 0. The Design of Education . London: Jossey-Bass, Inc., Publishers, 
1972. 

Hutchison, Dorothy J. "The Process of Planning Program's of Continuing Education. 
For Health f-lanpower," Fostering the Growing Need to Learn , A.N. Charters 
and R.J. Blakely (editors) H.E.W. Regional Medical Programs, July, 1973. 

Illich, Ivan. Tools for Conviviality . Vol-. 47. Harper and Row, Publishers: 
New York, 1973. 

Jes^ee, William F. and Goran, Michael J. "The Role of the Academic Medical 
Center In the PSRO Program," Journal of Me dical Education, Vol. 31, 
May, 1976. ' : 

Kampmeier, Rudolph-'H. "The Expanding Classroom:--. Trends and Issues in 

Postgraduate Education," Postgraduate Med icine. Vol. 61, No. 1, January, 
1977. — 

w 

'Kaufman, Roger A. Educational System Plannin g, Englwood Cliffs, New Jersey: 
. Prentice-Hall ,^1972: ' 

Kempfer, Homer. Adult Education . New York: • McGraw-Hill Book Company, 'Inc. , 
1955. ' ~ 

4 

Kidd, James Robbins. How Adults Learn . New York: Association Press, 1959. 

Knowles, Malcolm. The .Modern Practice of Adult Education . New York: Association 
Press, 1970. . — 

Knox', Alan B. "Designing Effective Programs of Continuing Professional 

Education." Teachers College, Columbia University, unpublished,- 1967. 

Knox, Alan B. "^Einerglng Directions in Continuing Professional Education," 
Consultation on, Continuing Educatlorf, Chicago, October 20, 1968. 

Knoxv Alan B. "Critical Appraisal Of The Needs' Of Adults For Educational Exper- 
iences As A Basis For Program Development." (unpubl ished mimeograph) 
University of Nel^aska, 1973. 



64 



ERIC 



Knox, Alan B., Woods, John, and Means, Robert. "Study of Continuing Education 
Needs of Illinois Library Personnel" Proposal to the Illinois State 
Library Association,. January 1974. 

Lewis, Robert V. "The Medical Society Rjresees A^^ole In The Accreditation Of » 
Continuing Education Programs," Rhode IslarTd Medital Journal : September, 
1973. . '~ - 

London, Jack. "Program Development in Adult Education," in Handbook of Adult 
Education in t.he United States, Malcolm S. Knowles (editor), Chicago:- 
Adult Education Association of the U.S.A. , 1560. 

Mann, Floyd C^Kptre, John, Reilly, Anthony and Vanselow, Neal A. "Thea 
Michigan Physician And His Continuing Education," Michigan Medicine , 
Volume 69, No. 2T through Volume 70, No. 13, November, 1970 through 

, June, 1971. - . 

Mas-low, A.H. Motivation and Personality ; New York: Harper and Brothers, 
1954. . ~" '\ 

. Mazmania'n,- Paul E. "Some Constructs of Adult Education PhiTosophy," unpubl-ished. 
University .of Michigan: Ann Arbor, 1976. 

Mazmanian, Paul E. and Pennington, ^loyd C. "Educational Needs Assessment in 
Continuing Mediral Education: A Neglected Essential ," Office of Continuing 
Education, University of Michigan Medical Cen.ter: Ann Arbor, 1977. 

Mazmaniaa, Paul E. and Pennington, Floyd C. "Identifying CME Needs," Michigan 
Medicine . Michigan State Medical Society i in. press. 

McClusky, Howard Y. "Education for Aging, The Scope of the Field and Perspectives 
for the Future," undated. 

McE-lTe3tfr,"Hark-'Pr— "How to Figure O^jt What Adults Want to Know," Adult Leader- 
ship , March, 1976. - 

Mendenhall, George. "Research, Evaluation and Diagnosis: Some Basic Distinc- 
tions," Viewpoints: Bulletin of the School -of Education, Indiana University ; 
Volume 49, No. 5; September, 1973. T"; ^ 

Meyer, Thomas C. "Towards the Identification of Educational Need "in Continuing . 
Medical Education in the USA," Anglo-American C onferences on Continuing 
Medical Education . April, 19747-^ "^^ 

Miller, George E. "The Orthopedic Training Study," The Journal of the Americari 
. Medical Association. Volume 206, October 14, 1968? ' 



65 



' Miller, Georqe E. "Why Continuing Medical Education?" The Hospital Medical 
Staff , (originally published .as "Continuing Education for What?" in ^ 
Journal of Medical Education , Aprif, 1967),, January, 1976. 

.Honnette, Maurice' L. "The Concept of Educational Need: An Analysis of 
Selected Literature," Adult Education Vol. XXVII, No. '2, 1977. 

Nakamoto, June and Verner, Coolie'. Continuing Education In The Health ; 
Professions . Education Resources Division Capijol Publications, Inc.;' 
Washington, D.Ci . ' ' ' ' 

Pennington, Floyd' C, Means, Robert, P., and Elliott, faul. "Rationale 

For Director Of Continuing Medical Education ^BMS," University of Illinois, 
Urbana- Champaign, unpublished. 

Pennington, Floyd and Green, Joseph." "Comparative Analysis of Program Develop- 
ment in Six Professions," Adult Education , Volume XXVII, Nor^l , Fall, 1976. 

Pennington, Floyd C. a'nd Moore, Donald E., Jr. "Before We Go Further With 
CME, We Must Consider These Issues," Michigan Medicine , Journal of the 
Michigan State Medical Society, Volume 76, Number 17, June, 1977. 

Pickett, Ralph E. "Continuing Education for Competency in the Smaller Community 
Hospital," Association for Hospital Medical Education Journal' . Spring, 



Powell, John Walker, and Benne, Kenneth D. "Philosophies of Adult Education" 
in Handbook of Adult Education in t^e United States . Malcolm.S. Knowles 
(editor), Chicago; Adult Educatlqn Association of J:he U.S.A., 1960. 

Richards, Robert King, Jr. Current Forces Influencing Continuing Medical Educa- 
tion in the Urrited States , (unpublished dissertation) Ph n, i!mvpr«:itv 
of Michigan, 1975. 

Richards, Robert K. "Continuing Medical Edueation" Journal ^df the American 
Medical Association . 236, 26: December 27, 1976^ \ 

Robbins, Joseph Nevirt. Doctoral Preliminary Examination in Adult Education . 
. • The Florida State University, Tallahassee, Floridci, October 5, 1976. 

Rockwell, Don A. "Keeping Up: Reported Journal Readings of Psychiatrists,"* 
Journal of Medical Education , Vol. 49, July, 1974. 

Rosenstein, Allen B. A Study' of a Profession and Professional Education , 
Reports Group, School of Engineering and Applied Science, University of 
California: Los Angeles, 1969. 



.66 



Rosen^in, Allen B. "Needs of U.S. Education, Government and Industry 
For National Professions -Foundation with Implications For Career " 
Development. and Training," Outline of a paper presented at the National 
University Extension Association National Conference, Tucson, Arizona, 



Rubenstein, Edward. "Continuing 'Medical Education at Stanford: The BacTc- 
to-Medical -School Program," Jo urnal of Medic al Education, Vol. 48, - 
October, 1973. ~ — : 

Sanazar^, Paul J. "How Medical; Audit and CME Affect Physician Performance 
'part 1," The Hospital Medical Staff . Chicago: . January, 1977. 

Schwab, Joseph J. The Practical ; A Language For Curriculum . Washington, D.O.: 
National Education Association Publications, 197Q. 

Shaw, .Nathan C. (editor). Administration of Continuing Education , Natignal 
Association for Public School -Adult Education: Washington, D.G., J969^. 

Shepard,- C.R. "History of ContinuingJIedical Education in the United -States 
Since 1930," Journal of M^^c^H Education . Vol; 35, August, 1960. ' * 

^ilvermaai'^'Mark E.- and Hurst, Willfs. "Education and the^CorhmuriityHospital ," 
Journal of the Medical Academy of Georgia , Vol. 63. April .^974. 

Sivertson, Sigurd E. , Hansen, Richard H., Shropshire, Richard "if. , Schoenenberger, 
Adeline 0. "Family Practice in Wisconsin," Wisconsi n Medical Journal, 
Vol. 73, December, -1974. ■* " ' ^ ■ — 

Smith, Donn L. "Continuing-^?" Journal of the Florida Me dical Association. 
Februarjf, 1974. " ~ - — — — '■ — ■ ^ • 

Smith, Robert M., Aker, George F. and Kidd J.R. (editors). Handbook of Adult 
Education. Toronto, Ontario: Collier-Macmillan Canada, litd., 1970.' ' 

Stein, Bonnie. "Competency Assessment and Continuing Medical Education" ' 
'(undated mimeograph)-. - - , - 

* 

Stein, Leonard. < Your Personal Learning Plan , Illinois Council on Continuing 
Medical Education: Chicago, 1973. 

5tewart, Will 1am H. -in "Solutions Held to Depend on Basic Care Provisions" • 
Chapter I, Health Manpower: Factors of Crisis . Medical Tribune, Inc.: 
•New York, 19687 '■ 

Storey, Patrick B., Williamson, John W. and Castle, C. Hilmon. Cohtinulng ' 
Medical Education: A New Emphasis , American Medical Association: » 
Chicago, 1968. ~ - 



1 



Stubblefield, Harold W. and f'oberts, Williahi B. "The Adult Educator As 

Diagnostician: A Report, " Viewpoints; ' Bulletin of the.ScHool QjF ' ^ 
Education, I^idiaria University ; Volume 49, No. 5; September, 197»." ^' . 

Tpffler, Aly.in. Future Shock . New York!: Bantam Books, Inc.: 1970. 

, Uhl, Henry. S-R/" "Continuing Education Program Of The Rhode Island' fledical 
* Society/ Rhode Island Medical Journal , September, 1973. 

Van Cleve, H.P. "Continuing Medical Education," Minnesota Medic'ine, April, 
•1974. • - ' 

Walker, Decker F. "A Naturalistic Model of-Curriculum Development," The 

School Review , Vol. 80 No. 1, November, 1971. " . . 

*'.'•■ 

Wan, Livia S. , ^Lehfeldt, Hans, Tsuei, Julia 3., Sobrero, Aquiles J,, and 

Douglas, Gordon W. "Continuting Educa'tion in'Fa^ily Planning' for ^acticing ^ 
Physicians,." American Journal of Public Health, Vol. 64, No. 1, oiffuary, 
1974. ^ ' - 

Wenden^ Ruth W., Fruehauf, Esther^ ^ent, Marilyn S., anfd Wilson, Constant D; 
"Detemination of Continuing MedicaT Education- Need^ of Clinicians from . 
a Literature Search Study," Bulletin of the Medical Library Association , 
- -Vol 65, No. 3, July, 1977. • ), ' 

Witkin, Belle Ruth. "An .Analysis ofiNaeds Assessment Techniques for Educational • 
Planning pf. State, Intermediate; and District Levels'^ Washington, D.C.: 
National Institute of Education (DHEW) Grant ^JNIE-G-74-0062^ May 19, 1975. ' 

World Health Orgaaization, "Continuing Education for Physicians: Report of a 
WHO Expert Coinmittee," World Health Organization Technical Report Series: 
Geneva, SwitzeHand, 1973. - . . 

Zelikoff, StB. The Obsolescence of Engineering Personnel under Conditions of 
Rapid Technological Change , Ph.D. Dissertation, University of Pennsylvania, 
Philadelphia, Pennsylvania, 1968. • • . 



6S 



ERIC 



